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Abstract 
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1 Introduction 



1.1 Overview 

The aim of this survey is to provide a unified treatment of moments and cumulants associ- 
ated with non-hnear functionals of completely random measures, such as Gaussian, Poisson or 
Gamma measures. We will focus on multiple stochastic integrals, and we shall mainly adopt a 
combinatorial point of view. In particular, our main inspiration is a truly remarkable paper by 
Rota and Wallstrom |106j . building (among many others) on earlier works by Ito [30], Meyer 
[591 rSOj and, most importantly, Engel [18j (see also Bitcheler Kussmaul ^42j, Linde [47\ . 
Masani [56], Neveu [62j and Tsilevich and Vershik [127j for related works). In particular, in 
[106j the authors point out a crucial connection between the machinery of multiple stochastic 
integration and the structure of the lattice of partitions of a finite set, with specific emphasis 
on the role played by the associated Mobius function (see e.g. [2], as well as Section [2] below). 
As we will see later on, the connection between multiple stochastic integration and partitions is 
given by the natural isomorphism between the partitions of the set {1, and the diagonal 

sets associated with the Cartesian product of n measurable spaces (a diagonal set is just a subset 
of the Cartesian product consisting of points that have two or more coordinates equal). 

The best description of the approach to stochastic integration followed in the present survey 
is still given by the following sentences, taken from [106j : 

The basic difficulty of stochastic integration is the following. We are given a 
measure ip on a set S, and we wish to extend such a measure to the product set 
S^. There is a well-known and established way of carrying out such an extension, 
namely, taking the product measure. While the product measure is adequate in 
most instances dealing with a scalar valued measure, it turns out to be woefully 
inadequate when the measure is vector-valued, or, in the case dealt with presently, 
random- valued. The product measure of a nonatomic scalar measure will vanish 
on sets supported by lower-dimensional linear subspaces of S". This is not the 
case, however, for random measures. The problem therefore arises of modifying the 
definition of product measure of a random measure in such a way that the resulting 
measure will vanish on lower-dimensional subsets of 5"", or diagonal sets, as we call 
them. 

As pointed out in [106j . as well as in Section [5] below, the combinatorics of partition lattices 
provide the correct framework in order to define a satisfactory stochastic product measure. 

As apparent from the title, in the subsequent sections a prominent role will be played by 
moments and cumulants. In particular, the principal aims of our work are the following: 

— Put diagram formulae in a proper algebraic setting. Diagram formulae are mnemonic 
devices, allowing to compute moments and cumulants associated with one or more random 
variables. These tools have been developed and applied in a variety of frameworks: see e.g. 
[11311122] for diagram formulae associated with general random variables; see [9l llH[Ml l51| 
for non- linear functionals of Gaussian fields; see [121j for non-linear functionals of Poisson 
measures. They can be quite useful in the obtention of Central Limit Theorem (CLTs) 
by means of the so-called method of moments and cumulants (see e.g. [49]). Inspired by 
the works by McCullagh [57], Rota and Shen [105j and Speed [117j . we shall show that all 
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diagram formulae quoted above can be put in a unified framework, based on the use of 
partitions of finite sets. Although somewhat implicit in the previously quoted references, 
this clear algebraic interpretation of diagrams is new. In particular, in Section H] we will 
show that all diagrams encountered in the probabilistic literature (such as Gaussian, non- 
flat and connected diagrams) admit a neat translation in the combinatorial language of 
partition lattices. 

— Illustrate the Engel-Rota-Wallstrom theory. We shall show that the theory developed 

in |18j and |106j allows to recover several crucial results of stochastic analysis, such as 
multiplication formulae for multiple Gaussian and Poisson integrals see |38l f75\ I121j . This 
extends the content of [106j . which basically dealt with product measures. See also [T9] 
for other results in this direction. 

— Enlight the combinatorial implications of new CLTs. In a recent series of papers (see 

|52l ESI Eg [TDl Ell ESl Eel [831 [861 a new set of tools has been developed, 

allowing to deduce simple CLTs involving random variables having the form of multiple 
stochastic integrals. All these results can be seen as simplifications of the method of 
moments and cumulants. In Section [H we will illustrate these results from a combinatorial 
standpoint, by providing some neat interpretations in terms of diagrams and graphs. In 
particular, we will prove that in these limit theorems a fundamental role is played by 
the so-called circular diagrams, that is, connected Gaussian diagrams whose edges only 
connect subsequent rows. 

We will develop the necessary combinatorial tools related to partitions, diagram and graphs 
from first principles in Section [2] and Section [H Section [3] provides a self-contained treament of 
moments and cumulants from a combinatorial point of view. Stochastic integration is introduced 
in Section \5\ Section [6] and Section [7] deal, respectively, with product formulae and diagram 
formulae. In Section [8] one can find an introduction to the concept of isonormal Gaussian 
process. Finally, Section [9] deals with CLTs on Wiener chaos. 

1.2 Some related topics 

In this survey, we choose to follow a very precise path, namely starting with the basic properties 
of partition lattices and diagrams, and develop from there as many as possible of the formulae 
associated with products, moments and cumulants in the theory of stochastic integration with 
respect to completely random measures. In order to keep the length of the present work within 
bounds, several crucial topics are not included (or are just mentioned) in the discussion to follow. 
One remarkable omission is of course a complete discussion of the connections between multiple 
stochastic integrals and orthogonal polynomials. This topic is partially treated in Section [8] 
below, in the particular case of Gaussian processes. For recent references on more general 
stochastic processes (such as Levy processes), see e.g. the monograph by Schoutens [lllj and 
the two papers by Sole and Utzet [115^ 1116] . Other related (and missing) topics are detailed in 
the next list, whose entries are followed by a brief discussion. 

— Wick products. Wick products are intimately related to chaotic expansions. A complete 

treatment of this topic can be found e.g. in Janson's book [36j . 
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— Malliavin calculus. See the two monographs by Nualart \74:\ [75] for Mahiavin calculus in 

a Gaussian setting. A good introduction to Malliavin calculus for Poisson measures is 
contained in the classic papers by Nualart and Vives [SlJ, Privault [98] and Privault and 
Wu [lOlj . A fundamental connection between Malliavin operators and limit theorems has 
been first pointed out in [77j. See [65l [671 [691 ES] for further developments. 

— Hu-Meyer formulae. Hu-Meyer formulae connect Stratonovich multiple integrals and multiple 

Wiener-Ito integrals. See [75] for a standard discussion of this topic in a Gaussian setting. 
Hu-Meyer formulae for general Levy processes can be naturally obtained by means of the 
theory described in the present survey: see the excellent paper by Farria et al. [19] for a 
complete treatment of this point. 

— Stein's method. Stein's method for normal and non-normal approximation can be a very 

powerful tool, in order to obtain central and non-central limit theorems for non-linear 
functionals of random fields. See [119] for a classic reference on the subject. See [69 ] [70 ] [71] 
for several limit theorems involving functionals of Gaussian fields, obtained by means of 
Stein's method and Malliavin calculus. See [86] for an application of Stein's method to 
functionals of Poisson measures. 

— Free probability. The properties of the lattice of (non-crossing) partitions and the corre- 

sponding Mobius function are crucial in free probability. See the monograph by Nica and 
Speicher [63] for a valuable introduction to the combinatorial aspects of free probabil- 
ity. See Anshelevich [3l [3] for some instances of a "free" theory of multiple stochastic 
integration. 

2 The lattice of partitions of a finite set 

In this section we recall some combinatorial results concerning the lattice of partitions of a finite 
set. These objects play an important role in the obtention of the diagram formulae presented 
in Section [5l The reader is referred to Stanley [118^ Chapter 3] and Aigner [2j for a detailed 
presentation of (finite) partially ordered sets and Mobius inversion formulae. 

2.1 Partitions of a positive integer 

Given an integer n > 1, we define the set A (n) of partitions of n as the collection of all vectors 
of the type A = (Ai, Afc) {k > 1), where: 



We call k the length of A. It is sometimes convenient to write a partition A = (Ai, A^) € A (n) 
in the form A = (l''^2'"2 • • • n^"). This representation (which encodes all information about A) 
simply indicates that, for every i = 1, ...,n, the vector A contains exactly rj (> 0) components 
equal to i. Clearly, if A = (Ai, A^) = (1^12^2 . . . ^r-„) ^ ^ ^^^^ ^-^^^ 



(i) Xj is an integer for every j = 1, fc, 

(ii) Al > As > • • • > Afc > 1, 

(iii) Al H h Afc = n. 



(2.1) 



Iri -!-••• + nvn = n 



(2.2) 
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and ri + ■ ■ ■ + Tn = k. We will sometimes use the (more conventional) notation 

A h n instead of A S A (n) . 

Examples, (i) If n = 5, one can e.g. have 5 = 4 + 1 or 5 = 1 + 1 + 1 + 1 + 1. In the first 
case the length is /c = 2, with Ai = 4 and A2 = 1, and the partition is A = (l^2'^3'^4^5'^) . In the 
second case, the length is A; = 5 with Ai = ... = A5 = 1, and the partition is A = (l^2*^3'^4^5'') . 

(ii) One can go easily from one representation to the other. Thus A = (l^2^3''4^) corresponds 

to 

n = (1 X 2) + (2 X 3) + (3 X 0) + (4 X 2) = 16, 
that is, to the decomposition 16 = 4 + 4 + 2 + 2 + 2 + 1 + 1, and thus to 

A = (Ai, A2, A3, A4, As, As, A7) = (4, 4, 2, 2, 2, 1, 1) . 

2.2 Partitions of a set 

Let b denote a finite nonempty set and let 

V (b) be the set of partitions of b. 

By definition, an element tt of "P (6) is a collection of nonempty and disjoint subsets of b (called 
blocks), such that their union equals b. The symbol |7r| indicates the number of blocks (or the 
size) of the partition tt. 

Remark on notation. For each pair i,j G b and for each vr G 'P{b), we write i j 
whenever i and j belong to the same block of vr. 

We now define a partial ordering on V (b). For every cr, vr G V {b), we write cr < vr if, and 
only if, each block of a is contained in a block of vr. Borrowing from the terminology used in 
topology one also says that vr is coarser than a. It is clear that < is a partial ordering relation, 
that is, < is a binary, reflexive, antisymmetric and transitive relation on V (b) (see e.g. [118^ p. 
98]). Also, < induces on V (b) a lattice structure. Recall that a lattice is a partially ordered set 
such that each pair of elements has a least upper bound and a greatest lower bound (see |1181 
p. 102]). In particular, the partition a A vr, meet of cr, vr G "P (6), is the partition of b such that 
each block of a A vr is a nonempty intersection between one block of a and one block of vr. On 
the other hand, the partition cr V vr, join of cr, vr G P (6), is the element of V (b) whose blocks are 
constructed by taking the non-disjoint unions of the blocks of a and vr, that is, by taking the 
union of those blocks that have at least one element in common. 

Remarks, (a) Whenever vri < vr2, one has |vri| > |vr2|. In particular, [cr A vr[ > |(T V vr|. 

(b) The partition u A vr is the greatest lower bound associated with the pair (cr, vr). As such, 
(7 A vr is completely characterized by the property of being the unique element of V (6) such that: 
(i) (7 A vr < 0", (ii) o" A vr < vr, and (iii) p < o" A vr for every p G V (b) such that /) < (t, vr. 

(c) Analogously, the partition uVvr is the least upper bound associated with the pair (o", vr). 
It follows that (T V vr is completely characterized by the property of being the unique element of 
V (6) such that: (i) a < cr V vr, (ii) vr < cr V vr, and (iii) cr V vr < p for every p £ V (b) such that 
(7,TT < p. 
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Examples, (i) Take 6 = {1,2,3,4,5}. If tt = {{1, 2, 3} , {4, 5}} and = {{1, 2} , {3} , {4, 5}} . 
Then, a < tt (because each block of a is contained in a block of tt) and 

a Att = a and cr V tt = tt. 

A graphical representation of tt, a, a An and o" V tt is: 



TT = 

a = 

a Att = 

ay TT = 



1 2 3 


4 5 


1 2 


3 4 5 


1 2 


3 4 5 


1 2 3 4 5 



(ii) If TT = {{1, 2, 3} , {4, 5}} and a = {{1, 2} , {3, 4, 5}}, then tt and a are not ordered and 
aA7r = {{l,2},{3},{4,5}} and a V tt = {6} = {{1, 2, 3, 4, 5}} . 

A graphical representation oi n, a, a Att and cr V vr is: 



TT = 

a = 

a Att = 

(T V TT = 



1 2 3 


4 5 


1 2 


3 4 5 


1 2 


3 4 5 


1 2 3 4 5 



(iii) A convenient way to build o" V vr is to do it in successive steps. Take the union of two 
blocks with a common element and let it be a new block of vr. Sec if it shares an element 
with another block of a. If yes, repeat. For instance, suppose that tt = {{1, 2}, {3}, {4}} and 
a = {{1, 3}, {2, 4}}. Then, tt and a are not ordered and 

aA7r = {{l},{2},{3},{4}} and a V tt = {{1, 2, 3, 4}} . 

One now obtains cr V vr by noting that the clement 2 is common to {1, 2} G vr and {2, 4} G cr, 
and the "merged" block {1,2,4} shares the element 1 with the block {1,3} € a, thus implying 
the conclusion. A graphical representation of tt, cr, a A tt and cr V tt is: 



vr 
cr 

cr A vr 
a V IT 



1 2 


3 


4 


1 3 


2 4 


1 2 


3 


4 


12 3 4 



Remark on notation. When displaying a partition vr of {l,...,n} (n > 1), the blocks 
bi, ...,bk £ vr will always be listed in the following way: bi will always contain the element 1, 
and 

min {i : i £ bj} < min {i : i G 6j+i} , i = 1, k — 1. 

Also, the elements within each block will be always listed in increasing order. For instance, if 
n = 6 and the partition vr involves the blocks {2} , {4} , {1, 6} and {3,5}, we will write vr = 
{{1,6}, {2}, {3, 5}, {4}}. 
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The maximal element of V (b) is the trivial partition 1 = {b}. The minimal element of 
V (b) is the partition 0, such that each block of contains exactly one element of b. Observe 
that |l| = 1 and |0| = \b\, and also < 1. If cr < vr, we write [cr, vr] to indicate the segment 
{p ^ V (b) : a < p < it}, which is a subset of partitions of b. Plainly, V (6) = [O, l] . 

2.3 Relations between partitions of a set and partitions of an integer 

We now focus on the notion of class, which associates with a segment of partitions a partition 
of an integer. In particular, the class of a segment [c, vr] (cj < vr), denoted A (cr, vr), is defined as 
the partition of the integer \a\ given by 



(2.3) 



where indicates the number of blocks of vr that contain exactly i blocks of cr. We stress that 
necessarily |cr| > |7r|, and also 

\a\ = Iri + 2r2 + • • • + |cr| r^^^ and |7r| = ri + • • • + r^^^. 

For instance, if vr = {{1, 2, 3} , {4, 5}} and a = {{1, 2} , {3} , {4, 5}}, then since {1, 2} and {3} 
are contained in {1, 2, 3} and {4, 5} in {4, 5}, we have ri = 1, r2 = 1, rs = 0, that is, A (cr, vr) = 
(l^2^3'') , corresponding to the partition of the integer 3 = 2 + 1. In view of (j2.ip . one may sup- 
press the terms = in ()2.3p . and write for instance A (d, vr) = (1^2*^3^) = (1^3^) for the class 
of the segment [a, vr], associated with the two partitions a = {{1} , {2} , {3} , {4} , {5} , {6} , {7}} 
and ^ = {{!}, {2, 3, 4}, {5, 6, 7}}. 



Now fix a set b such that \b\ = n > 1. Then, for a fixed A = (1^12^^ 
of partitions vr G 7^ (6) such that A (O, vr) = A is given by 



n 



h n, the number 



n 




n 


. A . 




- n, ...,rn . 



(1!)'^! ri!(2!)^2 ^^l . . . (n!)'^" r„! 



(2.4) 



(see e.g. |118| ). The requirement that A (C),vr) = A = [V^^^^ ■ ■ ■ n*"") simply means that, for 
each i = 1, ...,n, the partition vr must have exactly blocks containing i elements of b. Recall 
that ri,...,r„ must satisfy (|2.2p . 



From now on, we let 



[n] ={!,..., n}, n > 1. 



(2.5) 



With this notation, the maximal and minimal element of the set "P ([n]) are given, respectively, 
by 

'i = {N} = {{l, •••>"}} and 6 = {{l},...,{n}}.| (2.6) 



Examples, (i) For any finite set 6, one has always that 

A(6,i) = (1O20 • • • , 

because 1 has only one block, namely b, and that block contains |6| blocks of 0. 
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(ii) Fix k > I and let b be such that \b\ = n > k + I. Consider A = {V^2'^^ ■ ■ ■ n^") h n be 
such that Tfc = Vn-k = 1 and rj = for every j ^ k,n — k. For instance, if n = 5 and k = 2, 
then A = (l'^2^3^4''5'^) . Then, each partition vr € "P (6) such that A (O, tt) = A has only one block 
of k elements and one block of n — k elements. To construct such a partition, it is sufficient to 
specify the block of k elements. This implies that there exists a bijection between the set of 
partitions it G V (b) such that A (O, vr) = A and the collection of the subsets of b having exactly 
k elements. In particular, (j2.4p gives 

' l]=(l^=nl/ik\{n-k)l). 

(iii) Let b = [7] = {1,...,7} and A = (li233°4°5°6°7°) . Then, ([23)) implies that there are 
exactly ^^J^if ~ ^^'^ partitions tt G 'P{b), such that A(6,7r) = A. One of these partitions is 
{{1} , {2, 3} , {4, 5} , {6, 7}}. Another is {{1, 7} , {2} , {3, 4} , {5, 6}} . 

(iv) Let 6 = [5] = {!,... ,5}, a = {{1} , {2} , {3} , {4, 5}} and vr = {{1, 2, 3} , {4, 5}}. Then, 
cj < vr and the set of partitions defined by the interval [cr, vr] is {o", vr, pi, /J2, /O3}, where 

pi = {{1,2}, {3}, {4, 5}} 
P2 = {{1,3}, {2}, {4, 5}} 
P3 = {{1},{2,3},{4,5}}. 

The partitions pi, p2 and are not ordered (i.e., for every 1 < i 7^ i < 3, one cannot write 
pi < /Oj ) J and are built by taking unions of blocks of cr in such a way that they are contained in 
blocks of vr. Moreover, A(o-,vr) = {l^2^2,^A^b^) , since there is exactly one block of vr containing 
one block of u, and one block of vr containing three blocks of a. 

(v) This example is related to the techniques developed in Section 6.1. Fix n > 2, as well 
as a partition 7 = (71, 7fc) € A (n) such that 7^ > 2. Recall that, by definition, one has that 
7i > 72 > • ■ • > 7fc and 71 + • • • + 7a,. = n. Now consider the segment [O, vr] , where 

6 = {{l},{2},...,{n}}, and 

TT = {{1, ...,71} ,{71 + 1, •••,71 +72} , •••,{71 H ^-ik~i + l,.-,n}} . 

Then, the jth block of vr contains exactly 7j blocks of 0, j = 1, k, thus giving that the class 
A (0, vr) is such that A (O, vr) = (7172 ■ ■ • 7^) = 7, after suppressing the indicators of the type . 

2.4 Mobius functions and Mobius inversion formulae 

For cT, vr E V (b), we denote by p {a, vr) the Mohius function associated with the lattice V (b). It 
is defined as follows. If a ^ vr (that is, if the relation a < vr does not hold), then p {a, vr) = 0. If 
cr < vr, then the quantity p {a, vr) depends only on the class A {a, it) of the segment [cr, vr] , and is 
given by (see [2]) 

/i(a,vr) = (-l)"-^(2!)'-M3!)^^---((n-l)!)'-" (2.7) 

n-l 
j=0 

where n = \a\, r = |vr|, and A (cr, vr) = (^V^2'^^ ■ ■ ■ n^") (that is, there are exactly blocks of vr 
containing exactly i blocks of cr). Since 0! = 1! = 1, expressions (|2.7|) and (|2.8|) do not depend 
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on the specific values of ri (tlie number of blocks of vr containing exactly 1 block of a) and r2 
(the number of blocks of tt containing exactly two blocks of a). 

Examples, (i) If |6| = n > 1 and a (z V (b) is such that \a\ = k { < n ), then 

^{a,i) = {-l)'-'{k-iy.. (2.9) 

Indeed, in ()2.7p = 1, since 1 has a single block which contains the k blocks of a. In particular, 
/.(0,{6})=^(6,i) = (-ir-^ (n-1)!. 

(ii) For every vr G V {b), one has (vr, tt) = 1. Indeed, since (trivially) each element of vr 
contains exactly one element of vr, one has A (vr, tt) = 

The next result is crucial for the obtention of the combinatorial formulae found in Section 
[3] and Section [5] below. For every pair of functions G, F, from V (b) into C and such that 
VcT eV{b), 

G{a)= Fin) (resp. G (a) = ^ F (vr) ) (2.10) 

6<7r<CT a<n<i 

one has the following Mohius inversion formula: Vvr E V (b), 

Fi^)= Yl /^(^,^)G'(a) (resp. F (vr) = ^ (vr, a) G (a) ), (2.11) 

0<(T<7r 7r<(T<i 

where fi (•, •) is the Mobius function given in (12. 7p . For a proof of (|2.1ip . see e.g. [118^ Section 3.7] 
and [2]. To understand (j2.1ip as inversion formulae, one can interpret the sum Y^Q^„^„F{Tr) 
as an integral of the type F (vr) dir (and analogously for the other sums appearing in (j2.10p 
and (I21TI1 ). 

In general (see [1181 Section 3.7]), the Mobius function is defined by recursion on any finite 
partially ordered set by the following relations: 

fj, {x, x) = 1 Vx e P, 

^(3;,y) = -Exd^^j//^(^>^) ' y x,y e P : X -< y, (2.12) 
^i{x,y)=0 y x,y e P : X :^y, 

where P is a finite partially ordered set, with partial order ^, and we write x ~< y to indicate 
that X ^ y and x ^ y. For instance, P could be a set of subsets, with ^ equal to the inclusion 
relation C. In our context P = V (b), the set of partitions of b, and ^ is the partial order < 
considered above, so that (I2.12P becomes 

fi{a,a) = l ya £V (6) , 

l^ia,TT) = -Ea<p<nl^i^^p)^ V fJ, TT G P (6) : ^ < TT, (2.13) 

^((7,7r) = V f7,7r G P(6) : cr ^ vr, 

where we write a < vr to indicate that a < ir and a ^ it (and similarly for p < tt). The recursion 
formula (j2.12p has the following consequence: for each x <y, 



10 



which win be used in the sequel. The second equahty in ()2.14p is an immediate consequence 
of ()2.12p . To prove the first equahty in (j2.14p . fix x and write G (z) = lx<z- Since, triviaUy, 
^ (-^) = Yly^z ly=a;i One can let F (y) = ly=x in (|2.10p and use the inversion formula (j2.1ip to 
deduce that 

which is equivalent to (j2.14p . 

Now consider two finite partially ordered sets P, Q, whose order relations are noted, re- 
specively, and ^q. The lattice product of P and Q is defined as the cartesian product 
P X Q, endowed with the following partial order relation: {x,y) :^pxQ {x',y') if, and only if, 
X :<p x' and y :<q y'. Lattice products of more than two partially ordered sets are defined anal- 
ogously. We say (see e.g. \118\ p. 98]) that P and Q are isomorphic if there exists a bijection 
ip : P ^ Q which is order-preserving and such that the inverse of ip is also order-preserving; this 
requirement on the bijection ip is equivalent to saying that, for every x, x' G P, 

X :<p X if and only if ^\) (x) -<q ip [x') . (2.15) 

Of course, two isomorphic partially ordered sets have the same cardinality. The following result 
is quite useful for explicitly computing Mobius functions. It states that the Mobius function is 
invariant under isomorphisms, and that the Mobius function of a lattice product is the product 
of the associated Mobius functions. Point 1 is an immediate consequence of (j2.12p . for a proof 
of Point 2, see e.g. [TlHl Section 3.8]. 

Proposition 2.1 Let P, Q be two partially ordered sets, and let fip and denote their Mobius 
functions. Then, 

1. If P and Q are isomorphic, then /ip (x, y) = fig {ip (x) , ip (y)) for every x,y (z P, where ip 
is the bijection appearing in Ii2.15\) . 

2. The Mobius function associated with the partially ordered set P x Q is given by: 

IJ-PxQ [{x, y) , (x', y')] = HP [x, x') X fig {y, y') . 

The next result is used in the proof of Theorem 16.11 

Proposition 2.2 Let b be a finite set, and let 7r,o" G V (b) be such that: (i) a <tt, and (ii) the 
segment [cr, vr] has class (Ai,...,Afc) h |cj|. Then, [o", vr] is a partially ordered set isomorphic to 
the lattice product of the k sets V ([Aj]), i = 1, fc. 

Proof. To prove the statement, we shall use the fact that each partition in [a, it] is obtained 
by taking unions of the blocks of a that are contained in the same block of vr. Start by observing 
that (Ai, Afc) is the class of [cr, vr] if and only if for every i = 1, k, there is a block bi € tt 
such that bi contains exactly Aj blocks of a. In particular, k = \tt\. We now construct a bijection 
■0, between [cr, tt] and the lattice products of the V ([Aj])'s, as follows. 
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i) For i = 1, ...,k, write bij, j = 1, Aj, to indicate the blocks of a contained in 6j. 

ii) For every partition p € [o", vr] and every i = l,...,k, construct a partition Cih p) of [^i] = 

{1, Aj} by the following rule: for every j, I £ {1, Aj}, j I (that is, j and / belong 

to the same block of C (i, p)) if and only if the union hij U hi^i is contained in a block of p. 

iii) Define the application ^/^ : [a, vr] ^ P ([-^i]) x • • • x 'P ([A^]) as 

p^^l,{p):=[Q{l,p),...X{k,p)). (2.16) 



It is easily seen that the application ip in (|2.16|) is indeed an order-preserving bijection, verifying 
(|2l5]) for P = [a,TT] and Q = V{[\i]) x • • • x P([Afc]). ■ 



3 Combinatorial expressions of cumulants and moments 

We recall here the definition of cumulant, and we present several of its properties. A detailed 
discussion of cumulants is contained in the book by Shiryayev [113j : see also the papers by Rota 
and Shen [105J, Speed |117j and Surgailis [122 j . An analysis of cumulants involving different 
combinatorial structures can be found in [97l pp. 20-23] and the references therein. 



3.1 Cumulants 



For n > 1, we consider a vector of real-valued random variables X[„] = (Xi, ...,Xn) such that 
E < oo, Vj = 1, ...,n. For every subset b = {ji, ■■■,jk} ^ [n] = {1, ...,n}, we write 



and 



= Xj^ X ■ ■ ■ X X 



(3.1) 



where x denotes the usual product. For instance, Vm < n, 

X[^] = (Xi, .., Xm) and XN = X^ x ■ ■ ■ x X, 

ok „ ^ ^ ^ \ _ Tw / „• sr^k 



For every b = {ji, ...,jk} C [n] and (zi, Zk) G ^ , we let ^X;, (zi, .., Zk) = K exp [i^^^i zgXj^ 
The joint cumulant of the components of the vector X;, is defined as 



thus 



xiXu...,Xk) = i-iy 



Qk 



dzi - ■ ■ dzk 

Qk 



log {Zl, ..,Zk) 



\zi=...=Zk=0 



(3.2) 



logE 



exp i ^ ziXi 



£=1 



2l = --- = 2fc=0 



dzi - ■ ■ dzk 
We recall the following facts. 

(i) The application X^ i— > x O^b) is homogeneous, that is, for every h = {hi, hk) S M'^, 

x{hiXj^,...,hkXj^) = {U^e=ihe) xxi^b) ; 



(ii) The application X;, i— > x i^b) is invariant with respect to the permutations of b; 



12 



(iii) X (Xb) = 0, if the vector has the form = X;,/ U X;,//, with h' , h" 0, 6' n h" = and 
Xfe' and X;,// independent; 

(iv) if Y = \Yj : j G J} is a Gaussian family and if Xj„] is a vector obtained by juxtaposing 
n > 3 elements of Y (with possible repetitions), then x (^[n]) = 0- 

Properties (i) and (ii) follow immediately from (j3.2p . To see how to deduce (iii) from (j3.2p . 
just observe that, if Xf, has the structure described in (iii), then 

log^Xi, {zi,..,Zk)= log^x,, {zi : je G b') + log^x,,, {ze ■ ji G b") 
(by independence), so that 

^^-^-^log^X, (.!,..,..) 

Finally, property (iv) is proved by using the fact that, if X[„] is obtained by juxtaposing n > 3 
elements of a Gaussian family (even with repetitions), then log (7x5 (-^ij --^ -Zfc) has necessarily the 
form a (V) zi + ■ b ZiZj, where a (k) and b are coefficients not depending on the 
z/'s. All the derivatives of order higher than 2 are then zero. 

When |6| = n, one says that the cumulant x(^b)i given by (j3.2p . has order n. When 
Xj„] = (Xi, ...,Xn) is such that Xj = X, Vj = 1, ...,n, where X is a random variable in L" (P), 
we write 



X(X[„]) =Xn(X) (3.3) 



and we say that Xn (X) is the nth cumulant (or the cumulant of order n) of X. Of course, in 
this case one has that 

X^{X) = {-ir ^\oggx{z) , 

where gx {z) = E[exp(izX)]. Note that, if X, 1" E L" (P) (n > 1) are independent random 
variables, then (13. 2p implies that 



X„ (X + >^) = Xn {X) + Xn (1^) , 

since Xn {X + Y) involve the derivative of E exp ii {X + Y) Ti^^-^Zj 



with respect to zi 



3.2 Relations between moments and cumulants, and between cumulants 

We want to relate expectations of products of random variables, such as E to cumu- 

lants of vectors of random variables, such as xiXi,X2,X^). Note the disymmetry: moments 
involve products, while cumulants involve vectors. We will have, for example, x (^11-^2) = 
E[XiX2] - E[Xi]E[X2], and hence x{Xi,X2) = Cov(Xi,X2), the covariance of the vec- 
tor {Xi,X2). Conversely, we will have E [X1X2] = x (-'^i) X (-^^2) + xi^i, X2). Thus, using 
the notation introduced above, we will establish precise relations between objects of the type 
X (Xfe) = X {Xj : j & b) and E [X''] = E [IljgfeXj]. We can do this also for random variables that 
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are products of other random variables: for instance, to obtain xiYiY2,Y^), we apply the pre- 
vious formula with Xi = Y1Y2 and X2 = Y3, and get x {Y1Y2, Y3) = E [Y1Y2Y3] - E [Y1Y2] E [Y3]. 
We shall also state a formula, due to Malyshev, which expresses x(^i^i^) iii terms of other 
cumulants, namely in this case 

X {Y1Y2, = X (YuYs) X (I2) + X (Yi) X {Y2, 13) + X {Yi,Y2,Y3) . 

The next result, first proved in |55] (for Parts 1 and 2) and [50j (for Part 3), contains three 
crucial relations, linking the cumulants and the moments associated with a random vector X[„] . 
We use the properties of the lattices of partitions, as introduced in the previous section. 

Proposition 3.1 (Leonov and Shiryayev |45] and Malyshev [50] ) For every 6 C [n], 
1. 



E 



x(X5j---x(X6j; (3.4) 

7r={6i,...,6fe}GP(6) 



X(X,)= Y. (-ir'(r-l)!E(X'^0---E(X'^'-); (3.5) 

a-={ai,...,ar}&^{b) 



3. \/a = {bi,...,bk} eV{b), 



xU'\...,X'-)= Yl x(XiJ---x(XtJ. (3.6) 



T={ti,...,ts}£V{b) 

TV(T=i 

Remark. To the best of our knowledge, our forthcoming proof of equation ()3.6p (which 
is known as Malyshev's formula) is new. As an illustration of (|3.6p . consider the cumulant 
X {X1X2, in which case one has a = {61,62}, with 61 = {1,2} and 62 = {3}. There are 
three partitions r G P ([3]) such that rVo" = 1 = {1, 2, 3}, namely ri = 1, T2 = {{1, 3} , {2}} and 
ra = {{1} , {2, 3}}, from which it follows that x (^1^2, ^3) = X {Xi,X2,Xs)+x (^1^3) X (^2) + 
xiXi)x{X2Xs). 

Proof of Proposition 13.11 The proof of ()3.4p is obtained by differentiating the character- 
istic function and its logarithm, and by identifying corresponding terms (see [113j, [105^ Section 
6] or |117j ). We now show how to obtain (13. 5p and p.6p from ()3.4p . Relation ()3.4p implies that, 
Vfj = {oi, ar} G P (6), 

r 

niE[X'^^]= E X(X,J---X(X,J. (3.7) 

j=l 7r={bi,...,bfc}<CT 

We can therefore set G (a) = n^=i E [X"^] and F (ir) = x (XbJ • • • x (X^J in ([2T0]) and ([2TT]) . 
so as to deduce that, for every vr = {61, 6^} G V (6), 

r 

x(X,J...x(X5j= Y /^(^,vr)niE[X'^'^]. (3.8) 

a={ai,...,ar}<TT J=l 
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Relation (13. 5p is therefore a particular case of (13. 8|) . obtained by setting vr = 1 and by using the 
equality fi (cr, i) = (—1)''^'"^ {\a\ — 1)1, which is a consequence of (j2.7p . 

To deduce Malyshev's formula (13. 6p from ()3.5p and (13. Th . write X''-' = Yj, j = 1, ...,k (recall 
that the X''^ are random variables defined in (j3.ip ). and apply (j3.5|) to the vector Y = {Yi, Yfc) 
to obtain that 



x(x^\...,X'"=j = x{Yi,...,Yk)=x{Y) 

Yl {-lY~^{r-iy.E{YP')---E{YP-). (3.9) 

/3={pi,...,p,}GP([fc]) 

Now write a = {6i, 5^}, and observe that a is a partition of the set 6, while the partitions /3 
in (j3.9p are partitions of the first /c integers. Now fix /? G {pi,-",Pt-} G 'P([^])- Foi' ^ = 1; •••''') 
take the union of the blocks bj € a having j & pi, and call this union m. One obtains therefore 
a partition vr = {ui, ...,Ur} € "P (6) such that |7r| = = r. Thanks to (j2.7p and (j2.9p . 

(_1)-1(^_1)!=^(;34) =/,(^4) (3.10) 

(note that the two Mobius functions appearing in (j3.10p are associated with different lattices: 
indeed, ii l) refers to V {[k]), whereas fi (tt, l) is associated with V (b)). With this notation, 
one has also that E (Y^i) • • • E (Y?' ) = E (X"i) • • • E (X""-), so that, by (ISTD . 

E(YPi)---E(YP'-)=IE(X"^)---E(X«'-)= Y1 x(XtJ---x(XtJ. (3.11) 

T={tl,...,ts}<TT 

By plugging (j3.10p and (|3.1ip into (|3.9p we obtain finally that 

x(x^\...,x^'=) = ^(^'i) E X (Xi J • • • X (X* J 

(T<7r<i T={ti,...,ts}:T<Tr 

= ^ x(Xi,)---x(XiJ /x(7r,i)= x(XtJ---x(XiJ, 

reVib) 7re[rVo-,i] T:rV(T=i 

where the last equality is a consequence of (|2.14p . since 

E M{..i)=|j (3.12) 



Tre rVo-,1 



For a single random variable X, one has (j3.3p : hence. Proposition 13.11 implies 
Corollary 3.1 Let X be a random variable such that E < oo. Then, 

IE[^"] = E X\b,\{X)---X\b,\iX) (3.13) 

7r={f>i,...,fefc}GT'(M) 

X„(X) = (-l)'--i(r-l)!E(xl«il) •••e(xI'^'-I) (3.14) 

(T={ai,...,ar}GP(fe) 
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Examples, (i) Formula (j3.5p . applied respectively to 5 = {1} and to 6 = {1,2}, gives 
immediately the well-known relations 

X{X)=E{X) and xiX,Y) = E{XY) -E{X)E{Y) = Cov{X,Y) . (3.15) 

(ii) One has that 

x{Xi,X2,Xs) = E(XiX2X3)-E(XiX2)E(X3) 

-E {X1X3) E (X2) - E (X2X3) E (Xi) 
+2E(Xi)E(X2)E(X3), 

so that, in particular, 

X3 {X) = E {X^) - 3E (X^) E (X) + 2E {Xf . 

(iii) Let G[„] = (Gi,...,G„), n > 3, be a Gaussian vector such that E{Gi) = 0, i = l,...,n. 
Then, for every b C [n] such that \b\ > 3, we know from Section [3.11 that 

xiGb) = x{Gi:ieb) = 0. 

By applying this relation and formulae (j3.4p and (|3.15p to G[„], one therefore obtains the well- 
known relation 

E[Gi X G2 X • • • X Gn] (3.16) 

'>^n={{tuh},...,{ikdk}}enin]) ^ {GhGj,) • • • E (Gi.GjJ , n even 
0, n odd. 

Observe that, on the RHS of ()3.16p . the sum is taken over all partitions vr such that each block 
of TT contains exactly two elements. 



4 Diagrams and graphs 

In this section, we translate part of the notions presented in Section [2] into the language of 
diagrams and graphs, which are often used in order to compute cumulants and moments of 
non-hnear functionals of random fields (see e.g. P El [Ml EU I121[ I122| ). 



4.1 Diagrams 

Consider a finite set b. A diagram is a graphical representation of a pair of partitions (vr, a) C 
V (6), such that vr = {61, 6^} and a = {ti, ...,ti}. It is obtained as follows. 

1. Order the elements of each block 6j, for i = 1, fc; 

2. Associate with each block 6j € vr a row of vertices (represented as dots), in such a way 
that the jth vertex of the ith row corresponds to the jth element of the the block 6j; 

3. For every a = 1, /, draw a closed curve around the vertices corresponding to the elements 
of the block G o". 

We will denote by T (vr, a) the diagram of a pair of partitions (vr, a). 
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Examples, (i) If 6 = [3] and tt = a = {{1, 2} , {3}}, then T (vr, a) is represented in Fig. 1. 




Figure 1: A simple diagram 

(ii) If 6 = [8], and vr = {{1, 2, 3} , {4, 5} , {6, 7, 8}} and a = {{1, 4, 6} , {2, 5} , {3, 7, 8}}, then 
r (vr, a) is represented in Fig. 2. 















3 








• 


• 



Figure 2: A diagram built from two three-block partitions 

Hence, the rows in F (vr, a) indicate the sets in vr and the curves indicate the sets in a. 

Remarks, (a) We use the terms "element" and "vertex" interchangeably. 

(b) Note that the diagram generated by the pair (vr, a) is different, in general, from the 
diagram generated by (cr, vr). 

(c) Each diagram is a finite hypergraph. We recall that a finite hypergraph is an object 
of the type {V,E), where ^ is a finite set of vertices, and E is a collection of (not necessarily 
disjoint) nonempty subsets of V. The elements of E are usually called edges. In our setting, 
these are the blocks of a. 

(d) Note that, once a partition vr is specified, the diagram F (vr, a) encodes all the information 
on a. 

Now fix a finite set b. In what follows, we will list and describe several type of diagrams. They 
can be all characterized in terms of the lattice structure of V (6), namely the partial ordering < 
and the join and meet operations V and A, as described in Section [2j Recall that 1 = {b}, and 
is the partition whose elements are the singletons of b. 

Connected Diagrams. The diagram F (vr, cr) associated with two partitions (vr, a) is said to 
be connected if vr V cr = 1, that is, if the only partition p such that n < p and a < p 
is the maximal partition 1. The diagram appearing in Fig. 2 is connected, whereas the 
one in Fig. 1 is not (indeed, in this case vrVo" = vrVvr = vr7^ 1). Another example of a 
non-connected diagram (see Fig. 3) is obtained by taking 6 = [4], vr = {{1, 2} , {3} , {4}} 
and a = {{1, 2} , {3, 4}}, so that vr < cr (each block of vr is contained in a block of a) and 
vr V o" = o" 7^ 1. 
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Figure 3: A non-connected diagram 



In other words, F (tt, a) is connected if and only if the rows of the diagram (the blocks of 
tt) cannot be divided into two subsets, each defining a separate diagram. Fig. 4 shows 
that the diagram in Fig. 3 can be so divided. 







Figure 4: Dividing a non-connected diagram 

The diagram in Fig. 5, which has the same partition vr, but a = {{1, 3, 4} , {2}}, is 
connected. 

M ® 

}l 

Figure 5: A connected diagram 

Note that wc do not use the term 'connected' as one usually does in graph theory (indeed, 
the diagrams we consider in this section are always non-connected hypergraphs, since their 
edges are disjoint by construction). 

Non-flat Diagrams. The diagram F (vr, a) is non-flat if 

TT A (7 = 0, 

that is, if the only partition p such that p < n and p < a is the minimal partition 0. It is 
easily seen that vr A (T = if and only if for any two blocks bj G vr, ta G cr, the intersection 
bj n ta either is empty or contains exactly one element. Graphically, a non-flat graph is 
such that the closed curves defining the blocks of a cannot join two vertices in the same 
row (thus having a 'flat' or 'horizontal' portion). The diagrams in Fig. 1-3 are all flat, 
whereas the diagram in Fig. 5 is non-flat. Another non-flat diagram is given in Fig. 6, 
and is obtained by taking 5 = [7], tt = {{1, 2, 3} , {4} , {5, 6, 7}} and a = {{1, 4, 5} , {2, 7} , 
{3,6}}. 
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Figure 6: A non-Sat diagram 



Gaussian Diagrams. We say that the diagram F (vr, a) is Gaussian, whenever every block of 
a contains exactly two elements. Plainly, Gaussian diagrams exists only if there is an 
even number of vertices. When a diagram is Gaussian, one usually represents the blocks 
of a not by closed curves, but by segments connecting two vertices (which are viewed 
as the edges of the resulting graph). For instance, a Gaussian (non-fiat and connected) 
diagram is obtained in Fig. 7, where we have taken b = [6], tt = {{1, 2, 3} , {4} , {5, 6}} 
and a = {{1,4}, {2, 5}, {3, 6}}. 




Figure 7: A Gaussian diagram 

In the terminology of graph theory, a Gaussian diagram is a non-connected (non-directed ) 
graph. Since every vertex is connected with exactly another vertex, one usually says that 
such a graph is a perfect matching. 

Circular (Gaussian) Diagrams. Consider two partitions tt = {bi,...,bk} and a = {ti,...,ti} 
such that the blocks of a have size \ta\ = 2 for every a = Then, the diagram 

F (tt, cr) (which is Gaussian) is said to be circular if each row of F (vr, a) is linked to both 
the previous and the next row, with no other possible links except for the first and the last 
row, which should also be linked together. This implies that the diagram is connected. 
Formally, the diagram F (tt, a) is circular (Gaussian) whenever the following properties 
hold (recall that i ^„ j means that i and j belong to the same block of cr): (i) for every 
p = 2,...,k — 1 there exist ji h and j2 ^o- ^2 such that Ji,j2 £ bp, ii G 6p_i and 
^2 G bp^i, (ii) for every p = 2, k—1 and every j G bp, j i implies that i G 6p_i U bp^i, 
(iii) there exist ji ~o- ii and j2 ~ct 12 such that ji,j2 G b^, ii G and ^2 € 61, (iv) for 
every j & bk, j '^a i implies that i G 61 U bk-i (v) there exist ji ~o- ii and j2 ~a- ^2 such 
that ji,j2 G 61, zi G 62 and 12 & bk, (vi) for every j E bi, j i implies that i G 6^ U 62. 
For instance, a circular diagram is obtained by taking b = [10] and 

TT = {{1,2}, {3, 4}, {5, 6} {7, 8}, {9, 10}} 
a = {{1,3}, {2, 9}, {4, 6}, {5, 7}, {8, 10}}, 

which implies that F (tt, a) is the diagram in Fig. 8. 
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Figure 8: A circular diagram 



Another example of a circular diagram is given in Fig. 9. It is obtained from b = [12] and 

TT = {{1,2, 3}, {4, 5}, {6, 7}, {8, 9}, {10, 11, 12}} 
a = {{1,4}, {2, 11}, {3, 10}, {5, 7}, {6, 8}, {9, 12}}. 




Figure 9: A circular diagram with rows of different size 



Examples, (i) Thanks to the previous discussion, one can immediately reformulate Maly- 
shev's formula (|3.6p as follows. For every finite set b and every a = {bi, b^} € V (b), 

x(x^\...,X^^) = Yl x(XtJ---x(XiJ. (4.17) 

T={ti,...,ts}eV{b) 

r((T,T) is connected 

(ii) Suppose that the random variables Xi,X2,X3 are such that E|Xj|^ < oo, i = 1,2,3. 
We have already applied formula (j4.17p in order to compute the cumulant x i^i^2, ^s)- Here, 
we shall give a graphical demonstration. Recall that, in this case, 6 = [3] = {1,2,3}, and that 
the relevant partition is cr = {{1,2}, {3}}. There are only three partitions ti,T2,T3 € 7-* ([3]) 
such that r (cj, ti) , F (a, T2) and F (a, T3) are connected, namely ri = 1, T2 = {{1, 3} , {2}} and 
T3 = {{1},{2,3}}. The diagrams F((t, ri), T{a,T2) and F(c7, ra) are represented in Fig. 10. 
Relation (I4.17[) thus implies that 

X{X,X2,X3) = x{Xi,X2,X3) + x{Xi,X3)x{X2) + x{Xi)x{X2,X3) 

= X iXi,X2,Xs) + Gov (Xi, X3) E (X3) + E (Xi) Gov (X2, X3) , 

where we have used (|3.15p . 
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Figure 10: Computing cumulants hy connected diagrams 



4.2 Solving the equation a An = 

Let vr be a partition of [n] = {1, ...,n}. One is often asked, as will be the case in Section [6.11 to 
find all partitions a € V {[n]) such that 

CTA7r = 0, (4.18) 

where, as usual, = {{1} , {n}}, that is, is the partition made up of singletons. The use 
of diagrams provides an easy way to solve (j4.18p . since (j4.18p holds if and only if the diagram 
T{iT,a) is non-flat. Hence, proceed as in Section [4T1 by (1) ordering the blocks of vr, (2) 
associating with each block of vr a row of the diagram, the number of points in a row being 
equal to the number of elements in the block, and (3) drawing non-flat closed curves around the 
points of the diagram. 

Examples, (i) Let n = 2 and vr = {{1} , {2}} = 0. Then, ui = vr = and cj2 = 1 (as 
represented in Fig. 11) solve equation (|4.18p . Note that V ([2]) = {cti,(T2}. 



® 






® 







Figure 11: Solving a An = in the simplest case 

(ii) Let n = 3 and vr = {{1, 2} , {3}}. Then, ai = 6, 0-2 = {{1, 3} , {2}} and erg = {{1} , {2, 3}} 
(see Fig. 12) are the only elements of T' ([3]) solving ()4.18p . 



® 


® 






® 


® 




® 















Figure 12: Solving a An = in a three-vertex diagram 



21 



(iii) Let n = 4 and vr = {{1, 2} , {3, 4}}. Then, there are exactly seven a G "Plf^]) solving 
(j4.18p . They are all represented in Fig. 13. 




Figure 13: The seven solutions of a An = in a four-vertex diagram 

(iv) Let n = 4 and vr = {{1, 2} , {3} , {4}}. Then, there are ten a & V ([4]) that are solutions 
of (j4.18p . They are all represented in Fig. 14. 




Figure 14: The ten solutions of a A tt = in a three-row diagram 

In what follows (see e.g. Theorem 17.11 b elow) . we will sometimes be called to solve jointly the 
equations o" Avr = and uVvr = 1, that is, given vr, to find all diagrams F (vr, a) that are non-flat 
(cr A TT = 0) and connected (fi V vr = 1). Having found, as before, all those that are non-flat, 
one just has to choose among them those that are connected, that is, the diagrams whose rows 
cannot be divided into two subset, each defining a separate diagram. These are: the second 
diagram in Fig. 11, the last two in Fig. 12, the last six in Fig. 13, the sixth to ninth of Fig. 14. 
Again as an example, observe that the second diagram in Fig. 14 is not connected: indeed, in 
this case, vr = {{1, 2} , {3} , {4}}, a = {{1} , {2} , {3, 4}}, and vr V a = {{1, 2} , {3, 4}} / i. 

4.3 From Gaussian diagrams to multigraphs 

A multigraph is a graph in which (a) two vertices can be connected by more than one edge, 
and (b) loops (that is, edges connecting one vertex to itself) are allowed. Such objects are 
sometimes called "pseudographs" , but we will avoid this terminology. In what follows, we show 
how a multigraph can be derived from a Gaussian diagram. This representation of Gaussian 
diagrams can be used in the computation of moments and cumulants (see |25j or [51] ) . 

Fix a set b and consider partitions vr, a € P (6) such that F (vr, a) is Gaussian and vr = 
{bi, ...,bk}- Then, the multigraph r(vr,o"), with k vertices and \b\ /2 edges, is obtained from 
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r (tt, (t) as follows. 

1. Identify each row of F (tt, a) with a vertex of T (tt, a), in such a way that the ith row of 
r (tt, a) corresponds to the zth vertex Vi of F (tt, a). 

2. Draw an edge linking Vi and for every pair {x, y) such that x € bi, y & bj and x ~cr ?/• 
Examples, (i) The multigraph obtained from the diagram in Fig. 7 is given in Fig. 15. 




Figure 15: A multigraph with three vertices 

(ii) The multigraph associated with Fig. 8 is given in Fig. 16 (note that this graph has been 
obtained from a circular diagram). 




Figure 16: A multigraph built from a circular diagram 

The following result is easily verified: it shows how the nature of a Gaussian diagram can be 
deduced from its graph representation. 

Proposition 4.1 Fix a finite set b, as well as a pair of partitions (tt,©") C V (6) such that the 
diagram T{n,a) is Gaussian and \n\ = k. Then, 

1. F(7r, cr) is connected if and only i/r(7r, cr) is a connected multigraph. 

2. F (tt, a) is non-flat if and only ifV (vr, a) has no loops. 

3. F (tt, a) is circular if and only if the vertices vi,...,Vk o/ F (vr, cr) are such that: (i) there 
is an edge linking Vi and Vj+i for every i = 1, k — 1, and (ii) there is an edge linking Vk 
and vi . 
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As an illustration, in Fig. 17 we present the picture of a flat and non-connected diagram (on 
the left), whose graph (on the right) is non-connected and displays three loops. 




Figure 17: A non-connected Bat diagram and its niultigraph 



This situation corresponds to the case b = [8], 

TT = {{1,2}, {3, 4, 5}, {6, 7, 8}}, and 
a = {{1,2}, {3, 4}, {5, 8}, {6, 7}}. 

5 Completely random measures and Wiener-Ito stochastic in- 
tegrals 

We will now introduce the notion of a completely random measure on a measurable space 
(Z,Z), as well as those of a stochastic measure of order n > 2, a diagonal measure and a 
multiple (stochastic) Wiener-Ito integral. All these concepts can be unified by means of the for- 
malism introduced in Sections [2H11 We stress by now that the domain of the multiple stochastic 
integrals defined in this section can be extended to more general (and possibly random) classes 
of integrands. We refer the interested reader to the paper by Kallenberg ans Szulga [39j, as well 
as to the monographs by Kussmaul [l2], Kwapieh and Woyczyhski [441 Ch. 10] and Linde |47j . 
for several results in this direction. 

5.1 Completely random measures 

Diagonals and subdiagonals play an important role in the context of multiple integrals. The 
following definitions provide a convenient way to specify them. In what follows, we will denote 
by (Z, Z) a Polish space, where Z is the associated Borel a-field. 



Definition 1 For every n > 1, we write (Z^jZ"^) 
partition vr € ([?^]) and every B € 2", we set 



(Z®",^«^"), with = Z. For every 



{(zi, Zn) e Z'' : Zi = Zj if and only if i j} 



and = BDZ":. 



(5.1) 



Recall that i j means that the elements i and j belong to the same block of the partition 
vr. Relation (j5.ip states that the variables Zi and Zj should be equated if and only if i and j 
belong to the same block of tt. 
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Examples, (i) Since = {{1} , {?^}}, no two elements can belong to the same block, and 
therefore Bq coincides with the collection of all vectors (zi, z„) G B such that Zi ^ Zj, Mi ^ j. 

(ii) Since 1 = {{1, ...,n}}, all elements belong to the same block and therefore 

Bl = {{Zi, Zn) e B : Zi = Z2 = ... = Zn}- 

A set such as B^ is said to be purely diagonal. 

(iii) Suppose n = 3 and vr = {{1} , {2, 3}}. Then, Bj^ = {{zi,Z2, z^) e B : Z2 = z^, zi ^ Z2}. 

The following decomposition lemma (whose proof is immediate and left to the reader) will 
be used a number of times. 

Lemma 5.1 For every set B G Z"-, 

B = yJa(,V{[n])Ba = ^^^qB„. 

Moreover n Bfj = if tt ^ a. 
One has also that 

(^1 X ... X An)i = { {n^,A,) X ■ ■ . X {n^.Ai)) ^; (5.2) 

n times 

indeed, since all coordinates are equal in the LHS of (15. 2p . their common value must be contained 
in the intersection of the sets. 

Example. As an illustration of (15. 2p . let Ai = [0,1] and A2 = [0,2] be intervals in M^, 
and draw the rectangle 741X^42 G M^. The set {Ai x ^2)1 (that is, the subset of Ai x A2 
composed of vectors whose coordinates are equal) is therefore identical to the diagonal of the 
square {Ai n ^2) x (^1 ("1^2) = [0, 1]^. The set {Ai x ^2)1 can be visualized as the thick diagonal 
segment in Fig. 18. 
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Figure 18: A diagonal set 



We shall now define a "completely random measure" ip, often called an "independently 
scattered random measure". It has two characteristics: it is a measure and it takes values in 
a space of random variables. It will be denoted with its arguments as ip{B,uj), where S is a 
Borel set and is a point in the underlying sample space 0. The "size" of 99 will be controlled 
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by a non-random, cT-finite and non-atomic measure v, where (B) = Kip {B)"^ . The fact that v 
is non-atomic means that u {{z}) = for every z ^ Z. The measure will be used to define 
multiple integrals, where one integrates either over a whole subset of Z^, p > 1, or over a subset 
"without diagonals". In the first case we will need to suppose E \ip{B)^ < oo; in the second 
case, one may suppose as little as Kip {B)^ < oo. Since p > 1 will be arbitrary, in order to deal 
with the first case we shall suppose that E \{p {B)f < cx), Vp > 1, that is, ip G np>iLP (P). We 
now present the formal definition of ip. 

Definition 2 (1) Let u be a positive, a-finite and non-atomic measure on {Z,Z), and let 

Z^ = {BeZ:u{B)<oo}. (5.3) 

A centered completely random measure (in rip>iLP {¥)) on {Z,Z) with control measure 

u, is a function (p {■,■), from Z^ x Q to M, such that 

(i) For every fixed B £ Z^, the application uj ip {B , to) is a random variable; 

(ii) For every fixed B e Z^, ip (B) G np>iLP (P); 

(iii) For every fixed B £ Zy,K[p {B)] = 0; 

(iv) p (0) = 0; 

(v) For every collection of disjoint elements of Zy, Bi, Bn, the variables (p{Bi),..., ip (Bn) 

are independent; 

(vi) For every B,C £ Z^, E [ip (B) ip (C)] = u{Br\C). 

(2) When ip{-) verifies the properties (i) and (iii)-(vi) above and ip{B) G (P), V-B G Zy 
(so that it is not necessarily true that ip{B) G LP{¥), p > 3), we say that ip is a completely 
random measure in (P) . 

Two crucial remarks. (On additivity) (a) Let Bi, Bn, ■■■ be a sequence of disjoint 
elements of Z^, and let (/? be a completely random measure on {Z,Z) with control u. Then, for 
every finite N > 2, one has that U^^iBn G Z^, and, by using Properties (iii), (v) and (vi) in 
Definition [21 one has that 

N 

= u{u^^,Bn)-Y,''iBn) = 0, (5.4) 

n=l 

because v is a measure, and therefore it is finitely additive. Relation ()5.4p implies in particular 
that 

N 

^ (U^=ii?„) =Y,^ (Bn) , a.s.-P. (5.5) 

n=l 



E 



N 
n=l 



V^iBn) 
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Now suppose that Uj^j^-B^ G Z^. Then, by (jS.Sp and again by virtue of Properties (iii), (v) and 
(vi) in Definition [21 



E 



N 

E 

71=1 



E 



0, 



because ly is fi-additive. This entails in turn that 



'P{^n=lBn) 



T.n=lV(Bn), a.S. 



(5.6) 



where the series on the RHS converges in 
tion 

Z„ (P) : B 



. Relation 



simply means that the applica- 



f{B)^ 



is (T-additive, and therefore that every completely random measure is a a-additive measme with 
values in the Hilbert space (P). See e.g. Engel [18], Kussmaul [l2] or Linde [U] for further 
discussions on vector- valued measures. 

(b) In general, it is not true that, for a completely random measure ip and for a fixed a; G ri, 
the application 

Z^ ^R: B ^ ip{B,uj) 

is a (T-additive real-valued (signed) measure. The most remarkable example of this phenomenon 
is given by Gaussian completely random measures. See the discussion below for more details on 
this point. 

Remark on notation. We consider the spaces {Z,Z) and {Z"',Z"') = [Z^"-, Z®"'). Do not 
confuse the subset in (15. Ih . where vr denotes a partition, with the o"- field Z^^ in (15. 3p . where 
ly denotes a control measure. 

Now fix a completely random measure (p. For every n > 2 and every rectangle C = Ci x • • 
• X C„, Cj € Z^, we define (C) = if (Ci) x ■ ■ ■ x ip (Cn), so that the application C (^["l (C) 
defines a finitely additive application on the ring of rectangular sets contained in Z", with 
values in the set of a ((^)-measurable random variables. In the next definition we focus on those 
completely random measures such that the application ^jl"! admits a unique infinitely additive 
(and square- integrable) extension on Z'^. Here, the infinite additivity is in the sense of the 

(P) convergence. Note that we write (/^I"! to emphasize the dependence of not only on n, 
but also on the set [n] = {1, ...,n}, whose lattice of partitions will be considered later. 

Definition 3 For n > 2, we write Z"^ = {C G 2" : z^" (C) < oo\. A completely random 
measure ip, verifying points (i)-(vi) of Definition\^ is said to be good if, for every fixed n>2, 
there exists a (unique) collection of random variables 99^""' = {93^""' (C) : C G such that 

(i) {(^N(C):C7gZ:?}CL2(P); 

(ii) For every rectangle C = Ci x ■ ■ ■ x Cn, Cj G Z^, 



(^N {C) = ipiCi)---ip{Cn); 



(5.7) 
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(iii) is a a-additive random measure in the following sense: if C (z 2" is such that C = 
Uj^iCj, with the {Cj} disjoints, then 

oo 

(^["1 (C) = (^["1 (Cj) , with convergence (at least) in (P) . (5.8) 
i=i 

Note that, in the case n = 1, the cr-additivity of (p fohows from point (vi) of Definition [5] 
and the c-additivity of u (through convergence). In the case n > 2, the assumption that the 
measure ip is good imphes cr-additivity in the sense of (jS.Sp . 

Remark. The notion of a "completely random measure" can be traced back to Kingman's 
seminal paper [40]. For further references on completely random measures, see also the two sur- 
veys by Surgailis |122| and [123] (note that, in such references, completely random measures are 
called "independently scattered measures"). The use of the term "good", to indicate completely 
random measures satisfying the requirements of Definition [31 is taken from Rota and Wallstrom 
[106j . Existence of good measures is discussed in Engel [18j and Kwapieh and Woyczyhski [i^ 
Ch. 10]. For further generalizations of Engel's results the reader is referred e.g. to [39] and 

m- 

Examples. The following two examples of good completely random measures will play a 
crucial role in the subsequent sections. 

(i) A centered Gaussian random measure with control is a collection G = {G (B) : B G Z,^} 
of jointly Gaussian random variables, centered and such that, for every B,C € Zy^ E [G (C) G (i?)] 
= v (C B). The family G is clearly a completely random measure. The fact that G is also 
good is classic, and can be seen as a special case of the main results in [T8] . 

(ii) A compensated Poisson measure with control v is a completely random measure N = 

{NiB) : B € Zy}, as in Definition d such that, G Z^, N (B) '= N (B) - v{B), where 
{B) is a Poisson random variable with parameter v [B) = KN (B) = KN {B)^ . The fact that 
N is also good derives once again from the main findings of [18] . A more direct proof of this last 
fact can be obtained by observing that, for almost every uj, -/Vt"! (^w) must necessarily coincide 
with the canonical product (signed) measure (on {Z'^^Z'^)) associated with the signed measure 
on (Z, Z) given by A^ (•, a;) = N {-^uj) — u (■) (indeed, such a canonical product measure satisfies 
necessarily (15. TP ). Note that a direct proof of this type cannot be obtained in the Gaussian case. 
Indeed, if G is a Gaussian measure as in Point (i), one has that, for almost every w, the mapping 
B I— > G{B,Lu) does not define a signed measure (see e.g. [36* Ch. 1]). 

5.2 Single integrals and infinite divisibility 

Let ip he a completely random measure in the sense of Definition [21 with control measure z^. 
Our aim in this section is twofolds: (i) we shall define (single) Wiener-Ito integrals with respect 
to (f, and (ii) we shall give a characterization of these integrals as infinitely divisible random 
variables. 

The fact that single Wiener-Ito integrals are infinitely divisible should not come as a surprise. 
Indeed, observe that, since {Z, Z) is a Polish space and ly is non-atomic, the law of any random 
variable of the type ip (B), B €z Zy, is infinitely divisible. Infinitely divisible laws are introduced 
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in many textbooks, see e.g. Billingsley [7]. In particular, for every B ^ Zy there exists a unique 
pair {(? (B) , ob) such that {B) G [0, oo) and is a measure on R satisfying 

aB {{0}) = and / u^ub (du) < oo, (5-9) 
Jr 

and, for every A S M, 

^^^^ h / (exp(iAu) - 1 - iAu) as ((in) . (5.10) 



E [exp {iXip (B))] = exp 



The measure is called a Levy measure, and the components of the pair (c^(B), ub) are called 
the Levy-Khintchine exponent characteristics associated with if (B). Also, the exponent 

g2 rj^\ ^2 /• 

h / (exp (iAu) — 1 — iAu) as (du) 



is known as the Levy-Khintchine exponent associated with 93 (B). Plainly, if if is Gaussian, then 
as = for every B G Z^, (the reader is referred e.g. to [IIU] for an exhaustive discussion of 
infinitely divisible laws). 

We now establish the existence of single Wiener-Ito integrals with respect to a completely 
random measure ip. 

Proposition 5.1 Let ip he a completely random measure in (P), with a-finite control measure 
v. Then, there exists a unique continuous linear operator h 1— > ip{h), from L^ (u) into (P), 
such that 

m 

^{h) = Y,CjV{Bj) (5.11) 
i=i 

for every elementary function of the type 

m 

h{z)=Y,c,lB,{z), (5.12) 

where cj £ M and the sets Bj are in Zy and disjoint. 

Proof. In what follows, we call simple kernel a kernel h as in (j5.12p . For every simple kernel 
h, set ^{h) to be equal to (|5.11|) . Then, by using Properties (iii), (v) and (vi) in Definition [21 
one has that, for every pair of simple kernels h,h' , 

E [<f (h) if {h')] = [ h{z)h' {z)v{dz) . (5.13) 
Jz 

Since simple kernels are dense in {y), the proof is completed by the following (standard) 
approximation argument. If E L^(z^) and {hn} is a sequence of simple kernels converging to 
h, then (I5.13P implies that {ip{hn)} is a Cauchy sequence in L^(P), and one defines v'(/i) to be 
the L^(P) limit of ip{hn). One easily verifies that the definition of (p{h) does not depend on the 
chosen approximating sequence {hn}- The application h 1— > (p{h) is therefore well-defined, and 
(by virtue of (|5.13|) ) it is an isomorphism from L^ (v) into L^ (P). ■ 
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The random variable f{h) is usually written as 



h (z) (f (dz) , / hd(p or If (h) 



(5.14) 



and it is called the Wiener-Ito stochastic integral of h with respect to (p. By inspection of the 
previous proof, one sees that Wiener-Ito integrals verify the isometric relation 



E [if (h) V (g)] = J^h (z) g (z) v (dz) = {g, h)^,^^^ , Vg, /i G (u) 



(5.15) 



Observe also that 



Eip{h) = 0. 



If S G Z^, we write interchangeably (B) or 93(15) (the two 

objects coincide, thanks to (j5.1ip ). For every h £ L"^ (u), the law of the random variable (p (h) 
is also infinitely divisible. The following result provides a description of the Levy-Khintchine 
exponent of p (h). The proof is taken from [88j and uses arguments and techniques developed 
in |103j (see also [431 Section 5]). Following the proof, we present an interpretation of the result. 



Proposition 5.2 For every B G Z^, let ic? (B) , ob) denote the pair such that (? (B) G [0, 00), 



as verifies I15.9\) and 

IE [exp {iXip (B))] = exp 
Then, the following holds 



(B) 



+ / {ex.p {iXx) — 1 — iXx) as (dx) 
Jr 



(5.16) 



1. The application B 1— > c^{B), from Z^ to [0,oo), extends to a unique a- finite measure 
(? {dz) on (Z, Z), such that (? (dz) <C i' (dz) . 

2. There exists a unique measure a on (Z x M, ^ x 0(M)) such that a{B x C) = ub (C), 
for every B ^ Zy and C e B{R). 

3. There exists a function py : Z x B{R.) ^ [0,oo] such that (i) for every z ^ Z , py {z, •) is 
a Levy measur^ on (M,;B(M)) satisfying f^x^py {z,dx) < 00, (ii) for every C G B(R), 
Py (•, C) is a Borel measurable function, (Hi) for every positive function g (z, x) G Z®B (M), 



g (z, x) Py [z, dx) V {dz) 
4- For every (A, z) G M x define 




g (z, x) a {dz, dx) 



(5.17) 



Ky{X,z) 



A2 



I ( e'^"" -1-iXx] Py (z, dx) , 



(5.18) 



where Oy (z) = ^ (z); then, for every h ^ L"^ {u), \Ky {Xh (z) , z)[ {dz) < 00 and 



E[exp{iXip{h))] 



(5.19) 



exp 



exp 



Ky {Xh (z) , z) {dz) 



^ / h'^{z)al{z)u{dz)+ I I (e'^^'^'^'' -l-iXh{z)x) py{z,dx)iy{dz) 



^That is, pi, (2, {0}) = and min (l, x'^) {z, dx) < 00. 



30 



Proof. The proof follows from results contained in |103i Section II]. Point 1 is indeed a 
direct consequence of [103' Proposition 2.1 (a)]. In particular, whenever B £ Z is such that 
u (B) = 0, then E[ip (S)^] = (due to Point (vi) of Definition [2]) and therefore (B) = 0, thus 
implying <C z^. Point 2 follows from the first part of the statement of |103|, Lemma 2.3]. To 
establish Point 3 define, as in [1031 p. 456], 

-f{B) = c^{B)+ / mm {l, x^) aB{dx) = (B) + / mm{l,x^) a {B,dx) , 

whenever B € Z^, and observe (see [1031 Definition 2.2]) that 7 (•) can be canonically extended 
to a cT-finite and positive measure on (Z,Z). Moreover, since (B) = implies ^{B) = 
a.s.-P, the uniqueness of the Levy-Khinchine characteristics implies as before 7 (B) = 0, and 
therefore 7 {dz) <^ v (dz). Observe also that, by standard arguments, one can select a version of 
the density {d'y/dv) [z) such that {dj/dv) (z) < 00 for every z £ Z. According to |103[ Lemma 
2.3], there exists a function p : Z x B (R) 1-^ [0, 00], such that: (a) p{z,-) is a Levy measure on 
;S (M) for every z € Z, (b) p{-,C) is a Borel measurable function for every C S 'B(M), (c) for 
every positive function g {z,x) £ Z ®B (M), 



g {z , x) p {z , dx) -f (dz) = / / g {z,x) a{dz,dx) . (5.20) 
[ Jz Jr 

In particular, by using (I5.20p in the case g {z, x) = 1a {z) for A € Z^, 

x^ p{z,dx)^ {dz) = I x^aA{dx)< 00, 



since if {A) G (P), and we deduce that p can be chosen in such a way that, for every 2; € Z, 
Jjg x'^p {z, dx) < 00. Now define, for every z £ Z and C £ B (M), 

Pv {z,C) = ^{z) p{z,C) , 

and observe that, due to the previous discussion, the application p^ : ZxB (M) 1— > [0, 00] trivially 
satisfies properties (i)-(iii) in the statement of Point 3, which is therefore proved. To prove Point 
4, first define (as before) a function /i G (u) to be simple if h{z) = X^iLiOjlAi (2), where 
m G M, and {Ai,...,A n) is a finite collection of disjoint elements of Z,y. Of course, the class 
of simple functions (which is a linear space) is dense in (u), and therefore for every (v) 
there exists a sequence n > 1, of simple functions such that {h^ {z) — h (z))"^ v (dz) — > 0. 
As a consequence, since is u-finite there exists a subsequence n^, such that /i^^. (z) — > h (z) 
for v-a.e. z £ Z (and therefore for 7-a.e. z £ Z) and moreover, for every A £ Z^ the random 
sequence <~p {\Ahn) is a Cauchy sequence in (P), and hence it converges in probability. In the 
terminology of jl03l p. 460], this implies that every h G (i^) is 99-integrable, and that, for 
every A £ Z, the random variable (p {hi a), defined according to Proposition 15.11 coincides with 
h {z) if {dz), i.e. the integral of h with respect to the restriction of ip {■) to A, as defined in 
[1031 p. 460]. As a consequence, by using a slight modification of |103l Proposition 2.6jl, the 
function Kq onM x Z given by 

Ko (A, z) = cT^ {z) + ^ (e^^^ - 1 - i\x) p {z, dx) , 



^The difference lies in the choice of the truncation. 
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where cJq {z) = (^dc^ /d'y) (z), is such that \Kq {Xh (z) , z)\^ (dz) < oo for every h ^ Lp' (z/), 
and also 

E[exp(zAv7(/i))] = / KQ{\h{z),z)-i{dz). 
The fact that, by definition, in (j5.18p verifies 

{Xh {z) ,z) = Ko {Xh {z) , z) ^ {z) , Vz € Z, V/i G {v) , VA G M, 

dv 

yields (f5l^ . ■ 

Interpretation of Proposition 15.21 Let S be a given set in Zy. The characteristic 
function of the random variable (p{B) or V'(ls) involves the Levy characteristic {(?{B),aB), 
where c^(-B) is a non-negative constant and aB{dx) is a Levy measure on M. We want now 
to view B Zy as a. "variable" and thus to extend (?{B) to a measure (?{dz) on (Z, 2), and 
aB{dx) to a measure a{dz,dx) on Z (g);B(M). Consider first q^. According to Proposition 15.21 
it is possible to extend it to a measure a{dz,dx) on Z (g) S(M), which can be expressed as 

a{dz,dx) = py{z,dx)v{dz), (5.21) 

where is a function on Z x M, with the property that py{z, •) is a Levy measure for every z ^ Z. 
In view of (I5.2ip . the measure a{dz,dx) is thus obtained as a "mixture" of the Levy measures 
Pu{z, •) over the variable z, using the control measure as a mixing measure. A similar approach 
is applied to the Gaussian part of the exponent in (|5.16p . involving (P'{B). The coefficient (?{B) 
can be extended to a measure (?{dz), and this measure can be moreover expressed as 

c^{dz) = al{z)u{dz), (5.22) 

where o"^ is the density of (? with respect to v. This allows the to represent the character- 
istic function of the Wiener-Ito integral '^{h) as in ()5.19p . In that expression, the function 
h{z) appears explicitly in the Levy-Khinchine exponent as a factor to the argument A of the 
characteristic function. 



Examples, (i) If (/? = G is a centered Gaussian measure with control measure then a = 
and (? = V (therefore = 1) and, for h ^ L? {v), 



— / K'{z)v{dz) 



E[exp(iAG(/i))] = exp 



(ii) If = iV is a compensated Poisson measure with control measure v, then (•) = 
and py {z, dx) = 6i {dx) for all z & Z, where 5i is the Dirac mass aX x = \. It follows that, for 
/iGL2 {v), 



E 



exp ( iXN {h) 



JXh{z) 



e""'"'~' — 1 — iXh {z) I u {dz) . 



(iii) Let {Z, Z) be a measurable space, and let iV be a centered Poisson random measure on 
MxZ (endowed with the usual product ci-field) with cj-finite control measure {du,dz). Define 
the measure p on {Z, Z) by 



p{B)= 1 1 u^Ib {z) u {du,dz) . 
Jr Jz 
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Then, by setting {u, z) = ulg (z), the mapping 



ks {u, z) N (du, dz) 



uIb (z) N {du, dz) 



(5.23) 



where B £ = {B E 2 : /U (B) < oo}, is a completely random measure on (Z, Z), with control 
measure fj.. In particular, by setting ks {u, z) = uIb (z), one has that 



E[exp {iX(p{B))] 



E 

exp 



exp 



exp 



exp 



exp ( iXN {ks 



1 — zAu I 1b (z) (dii, dz) 



1 — i\u \ as (du) 



(5.24) 



where as (du) = J^Ib {z) v {du, dz) (compare with (j5.10p ). 

(iv) Keep the framework of Point (iii). When the measure is a product measure of the type 
V {du, dx) = p {du) P {dx), where (3 is u-finite and p {du) verifies p ({0}) = and u^p {du) < oo 
(and therefore ob {du) = P {B) p {du)), one says that the completely random measure (p in ()5.23p 
is homogeneous (see e.g. [85]). In particular, for a homogeneous measure ip, relation ()5.24p gives 



E [exp {iXp {B))] = exp 



P{B) 



iXu 



1 — iXu] p {du) 



(5.25) 



(v) From (|5.25p and the classic results on infinitely divisible random variables (see e.g. PllOj), 
one deduces that a centered and square-integrable random variable Y is infinitely divisible if 
and only if the following holds: there exists a homogeneous completely random measure ip on 
some space {Z,Z), as well as an independent centered standard Gaussian random variable G, 
such that 

Y ^ aG + Lp {B) , for some a > and B G Z. 

(vi) Let the framework and notation of the previous Point (iii) prevail, and assume moreover 
that: (1) {Z,Z) = ([0, oo), ;B ([0, oo))), and (2) v{du,dx) = p{du)dx, where dx stands for the 
restriction of the Lebesgue measure on [0,oo), and p verifies /o({0}) = and J^u^p{du) < oo. 
Then, the process 



t^(^([0,i]) 



R J [0,t] 



uN {du, dz) , t> 0, 



(5.26) 



is a centered and square-integrable Levy process (with no Gaussian component) started from 
zero: in particular, the stochastic process t i-^- V9([0,t]) has independent and stationary incre- 
ments. 

(vii) Conversely, every centered and square-integrable Levy process Zt with no Gaussian 

component is such that Zt (/j([0,t]) (in the sense of stochastic processes) for some ip{[0,t]) 
defined as in (j5.26p . To see this, just use the fact that, for every t, 



E [exp {iXZt)] = exp 



1 — iXu^ p {du) 
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where the Levy measure verifies p ({0}) = and Jj^ v?p (du) < oo, and observe that this last 
relation imphes that </?([0, i]) and Zt have the same finite-dimensional distributions. This fact 
is the starting point of the paper by Farras et al. [19], concerning Hu- Meyer formulae for Levy 
processes. 

Remark. Let (Z, Z) be a measurable space. Point 4 in Proposition 15.21 implies that every 
centered completely random measure (p on (Z, Z) has the same law as a random mapping of the 
type 

B^G{B)+ [ [ ulBiz)N {du,dz) , 



where G and N are, respectively, a Gaussian measure on Z and an independent compensated 
Poisson measure on M x Z. 

Examples, (i) (Gamma random measures) Let (Z, Z) be a measurable space, and let A'^ be 
a centered Poisson random measure onMxZ with cr-finite control measure 

ly (du, dz) = ^^ni — ^l„>Q(fu/? [dz) , 
u 

where (3 [dz) is a fi-finite measure on {Z,Z). Now define the completely random measure </? 
according to (|5.23p . By using (15.241) and the fact that 

GXp i — u) 

as {du) = (3 (B) 'i-u>odu, 

u 



one infers that, for every B G Z such that (3 (B) < oo and every real A 
K[exp {iXip (B))] = exp 



PiB) ^(e^'--l-^Xu) '-^^du 







u 



exp 



(l-U) 



exp {-iX(3 (B)) , 



exp(-iA/3 (B)) 



thus yielding that (/? {B) is a centered Gamma random variable, with unitary scale parameter 
and shape parameter [3 (B). The completely random measure ip {B) has control measure /3, and 
it is called a (centered) Gamma random measure. Note that p (B) + /3 {B) > 0, a.s.-P, whenever 
< P (B) < oo. See e.g. [271 EH ESJ I125j . and the references therein, for recent results on 
(non-centered) Gamma random measures. 

(ii) (Dirichlet processes) Let the notation and assumptions of the previous example prevail, 
and assume that < (3 (Z) < oo (that is, (3 is non-zero and finite). Then, p (Z) + (3 [Z) > and 
the mapping 

B_^(|)±|(|) (5.27) 

defines a random probability measure on (Z, Z)^ known as Dirichlet process with parameter (3. 
Since the groundbreaking paper by Ferguson [21], Dirichlet processes play a fundamental role 
in Bayesian non-parametric statistics: see e.g. |341 [58] and the references therein. Note that 
(|5.27|) does not define a completely random measure (the independence over disjoint sets fails): 
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however, as shown in [M], one can develop a theory of (multiple) stochastic integration with 
respect to general Dirichlet processes, by using some appropriate approximations in terms of 
orthogonal [/-statistics. See [97] for a state of the art overview of Dirichlet processes in modern 
probability. 



5.3 Multiple stochastic integrals of elementary functions 

We now fix a good completely random measure in the sense of Definition [3] of Section 15.11 
and consider what happens when (/pI"! is applied not to C € -Z" but to its restriction C-,^, where 
vr is a partition of [n] = {L n}. The set C^r is defined according to (|5.1|) . We shall also apply 
^jl"! to the union U(j>7rCo-o It will be convenient to express the result in terms of C, and thus to 
view (/^["l (Ctt), for example, not as the map applied to (7,^, but as a suitably restricted map 
applied to C. This restricted map will be denoted St^''"', where "St" stands for "Stochastic". 
In this way, the restriction is embodied in the map, that is, the measure, rather than in the set. 
Thus, fix a good completely random measure (p, as well as an integer n > 2. 



Definition 4 For every vr € "P ([n]), we define the two random measures^ 



St^'M (C) ^ v'N (C^) , 



and 



st^f (C) ^ {yj.>M = E.>. st^'["i (C) 



(5.28) 
(5.29) 



that are the restrictions of (f^"'' , respectively to the sets Z'^ and VJ^y-j^Z^. 



In particular, one has the following relations: 

• St^'i"^ = (/^["l, because the subscript " > 6 " involves no restriction. Hence, St^'l"^ charges 
the whole space, and therefore coincides with yjl"! (see also Lemma l5.ip : 

• Stg'^"^ does not charge diagonals; 

• St^^"^ charges only the full diagonal set Z"; 

• for every a G P ([n]) and every C G ^^J , St^']."' (C) = St^'l"^ (C n Z^). 



We also set 

St^'W(C7) = St^'W(C) = (^(C), C7gZ^. (5.30) 

Observe that (j5.30p is consistent with the trivial fact that the class "P ( [1] ) contains uniquely the 
trivial partition {{1}}, so that, in this case, 1 = = {{1}}- 

■^From here, and for the rest of the paper (for instance, in formula (|5.29|l '). the expressions "cr > tt" and "tt < a" 
are used interchangeably. 

*Here, we use a shght variation of the notation introduced by Rota and Wallstrom in [lU6j . In particular, Rota 
and Wallstrom write StjT' and respectively, instead of St^''"' and St^']"'. 
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We now define the class £ {v^) of elementary functions on Z". This is the collection of all 
functions of the type 

m 

/(zj = J^fc.lc, (z„), (5.31) 
i=i 

where kj € M and every Cj € has the form Cj = Cj x ■ ■ ■ x Cj', Cj & {I = 1, n). For 
every f € £ [v'^) as above, we set 



St^'W(/) = / /dSt^'M= V%St^'N(c^.) (5.32) 

,=1 

„ m 

Sttfif) = / /dSt^f = 5]%St^f (C,), (5.33) 

and we say that St^''"' (/) (resp. St^']"' (/)) is the stochastic integral of / with respect to St^'^"^ 

(resp. St^i"^ (/)). For C G Z^, we write interchangeably St^'t"^ (C) and St^'^"^ (Ic) (resp. 
St|'f^ (C) and St^i"^ (Ic)). Note that ([ST^ yields the relation 

St^f (/) = 5]St^'N (/). 



cr>7r 



We can therefore apply the Mobius formula (j2.1ip in order to deduce the inverse relation 

St^'N(/) = j;^(vr,a)St^']"l(/), (5.34) 

(j>7r 

(see also \Wi)\ Proposition 1]). 

Remarks, (i) The random variables St^''""' (/) and St^']"^ (/) are elements of (P) for 
every / G £{v'^). While here / is an elementary function, it is neither supposed that / is 
symmetric nor that it vanishes on the diagonals. 

(ii) Because / is elementary, the moments and cumulants of the integrals (|5.32p and (j5.33p 
are always defined. They will be computed later via diagram formulae. 



5.4 Wiener-Ito stochastic integrals 

We consider the extension of the integrals St^''"' (/) to non-elementary functions / in the case 
vr = = {{1} , {n}} . In view of (j5.1|) and (|5.28|) . the random measure St^''"' does not charge 
diagonals (see Definition [H as well as the subsequent examples). 

We start with a heuristic presentation. While relation (|5.14p involves a simple integral over 
Z, our goal here is to define integrals over with respect to St^''"', that is, multiple integrals 
of functions / : Z" i-^ M, of the form 

I^{f)= I f{zi,...,Zn)v{dzi)---^{dZn). 

Since the integration is over we are excluding diagonals, that is, we are asking that the 
support of the integrator is restricted to the set of those (zi, z^) such that Zi ^ Zj for every 
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i j, 1 < i,j < n. To define the multiple integral, we approximate the restriction of / to 
Zq by special elementary functions, namely by finite linear combinations of indicator functions 
Icix - xCni where the Cj's are disjoint sets in Z^. This will allow us to define the extension by 
using isometry, that is, relations of the type 



E 



n\ i f{zi,...,Zn) V [dxi) ■ ■ ■ V [dXn) 
J Z'^ 

n\ f (zi, Znf V (dxi) ■ ■ - u (dXn) . 



(5.35) 



Note that the equality ()5.35p is due to the fact that the control measure u is non-atomic, and 
therefore the associated product measure never charges diagonals. It is enough, moreover, to 
suppose that / is symmetric, because if 



/ (Zl, Z^) = — ^2 f {Zw{l), ■■■,Zw(^n)) 



(5.36) 



is the canonical symmetrization of / (©« is the group of permutations of [n]), then 



(5.37) 



This last equality is just a "stochastic equivalent" of the well known fact that integrals with 
respect to deterministic symmetric measures are invariant with respect to symmetrizations of 
the integrands. Indeed, an intuitive explanation of (I5.37P can be obtained by writing 



J Z" L 



and by observing that the set is symmetricjl, so that In (/) appears as an integral with respect 
to the symmetric stochastic measure l^.dc/^t"'. 

From now on, we will denote by -2^"^ = (the dependence on i/ is dropped, whenever there 
is no risk of confusion) the symmetric a-Geld generated by the elements of Z'^ of the type 



C 



[J C«)(l) X C'u.(2) X 



c. 



w(n) 1 



(5.38) 



where {Cj : j = 1, ...,n} C Zi^ are pairwise disjoint and is the group of the permutations of 



n 



Remark. One can easily show that Z^ is the <T-field generated by the symmetric functions 
on that are square- integrable with respect to z/", vanishing on every set Z^ such that tt ^ 0, 



that is, on all diagonals of Z"" of the type 



< ij < n. 



By specializing (j5.28p - (j5.33p to the case vr = 0, we obtain an intrinsic characterization of 
Wiener-Ito multiple stochastic integrals, as well as of the concept of stochastic measure of order 
n > 2. The key is the following result, proved in [1061 p. 1268]. 



^That is; {zi, Zn) G implies that (^i^jjij, £ for every w G &„ 
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Proposition 5.3 Let if be a good completely random measure. 

(A ) For every / G f (z^"), 

stf (/) = st^^'["] (7) , 

where f is given in i5. 36\) . In other words, the measure Stg'^"^ is symmetric. 

(B) The collection Ist^''"' (C) : C G is the unique symmetric random measure on Z"^ 

verifying the two properties: (i) St^''"^ (C) = for every C G 2" such that C C for some 
TT 7^ 0, and (ii) 

St^'t"] (c) = St^'["l (Ig) = n!v9(C7i) x (^(^2) x ■ • • x <^ (C„) , (5.39) 
for every set C as in ^5.3^) . 

Remark. Note that Stg'^"' is defined on the c-field 2", which also contains non-symmetric 
sets. The measure Stg'^"^ is "symmetric" in the sense that, for every set C G 2^", the following 
equality holds: Stg'^"^ (C) = St^'^"^ (C*^), a.s.-P, where id is a permutation of the set [n] and 

Cw = {{zi, .■.,Zn) G : ( 

Zw{l) 1 •••) Zui(n) 

We denote by (i/") the Hilbert space of symmetric and square integrable functions on 
(with respect to v^). We also write Ssfl (i^"") to indicate the subset of (v^) composed of 
elementary functions vanishing on diagonals, that is, the functions of the type / = X^JLi kjl^ , 

where kj G M and every Cj C Z"^ has the form (j5.38p . The index in (z^") refers to the 
fact that it is a set of functions which equals on the diagonals. Since is non-atomic, and z^" 
does not charge diagonals, one easily deduces that £"^^0 (i^"") is dense in {^^)- Moreover, the 
relation (j5.39|) implies that, Vn, m > 2, 



E 



St ^'["^1 (/) St ^'["1 {g)] = 6n,m x^'-j^J M 9 (Zn) (dz^) , (5.40) 



V/ G £s,o (i^^) and \/g G Ss,o {i^^), where 6n,m = 1 if n = m, and = otherwise. This immediately 
yields that, for every n > 2, the linear operator / i-^ St?'''"' (/), from £"^^0 (f^"") into (P), can 
be uniquely extendend to a continuous operator from (z^") into (P). It is clear that these 
extensions also enjoy the orthogonality and isometry properties given by (j5.40p . 



Definition 5 For every f ^ L"^ ^he random variable Stg''"' (/) is the multiple stochastic 

Wiener-Ito integral (of order n) of f with respect to ip. We also use the classic notation 



St ^'['^l (/) = /;?(/), /GL2(z."). 



(5.41) 



Note that 



E [/^ (/) [g)] = 5n,m xn] [ f (z„) g (z„) (dz„) , (5.42) 
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V/ G (i^"^) andyg € (i^")- Forn > 2, the random measure |st^''"' (C) : C € is called 

the stochastic measure of order n associated with ip. When f G (v^) (not necessarily 
symmetric), we set 

I^{f)=im, (5.43) 
where f is the symmetrization of f given by i5. 36\) . 



We have supposed so far that (p{C) E L^iF), p > 3, for every C & Zi, (see Definition [2]) . 
We shall now suppose that (p (C) G (P), C G Zi,. In this case, the notion of "good measure" 
introduced in Definition [3] and Proposition 15.31 do not apply since, in this case, (/^t""' may not 
exist. Indeed, consider (|5.7p for example with Ci = ... = Cn & Z^. Then, the quantity 



E 



(C) ^ = E\ip{Ci)f'' 



may be infinite (see also [18j). It follows that, for n > 2, the multiple Wiener- Ito integral cannot 
be defined as a multiple integral with respect to the restriction to of the "full stochastic 
measure" (p^""^. Nontheless, one can always do as follows. 



Definition 6 Let ip be a completely random measure in L (P) (and not necessarily in {¥), 
p>3), with non-atomic control measure v. For n>2, let 

m 

I^n if) = n! J^T. X (Cf ^ (Cf ) . . . (C7W)} , (5.44) 

k=l 

for every simple function f G Ylk=i'yk'^cW ^ ^sfli'^'"'), where every is as in \5.38\) . It 

is easily seen that the integrals In (/) defined in ^5.44^ still verify the iP' (P) isometry property 
\5.4^ . Since the sets of the type C generate Z^, and v is non-atomic, the operator In (•) can be 
extended to a continuous linear operator from (z^") into iP' (P), such that \5.4^ is verified. 
When f ^ LP {u"') (not necessarily symmetric), we set 

i^if) = m), 

where f is given by 115. 36\) . 



Remark. Of course, if (/9 G Dp^iLP (P) (for example, when is a Gaussian measure or a 
compensated Poisson measure), then the definition of In obtained from (I5.44p coincides with 
the one given in ()5.4ip . 

5.5 Integral notation 

The following "integral notation" is somewhat cumbersome but quite suggestive: for every n > 2, 
every a €V {[n]) and every elementary function f £ S (z^"), 



g^V,N ^ j^^ f {zi,...,Zn)^{dzi) ■ ■ -ipidZn), 
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and 



For instance: 

. if n = 2, / (zi, Z2) = /i (zi) /2 (Z2) and a = 6 = {{1} , {2}}, then 



h if) = St^'P] (/) 



/i (^i) /2 iz2) <f (dzi) LP {dz2) ; 



if n = 2, / (zi, Z2) = /i (zi) /2 (Z2) and a = 1 = {I, 2}, then 



stfi'i (/) 



/i (^i) /2 (22) {dzi) LP {dz2) ; 



if n = 2, 



St^f (/) 



^*{{l},{2}} (/) + ^*{{1,2}} 

f {zi, Z2) ip (dzi) LP {dz2) + 

f {zi,Z2)LpidZi)Lp{dZ2) ■ 
Z2 



f {zi,Z2)(pidzi)Lp{dz2) 



if n = 3, / (2:1,22, 2:3) = /i (^^1, 2:2) /2 (2:3) and = {{1, 2} , {3}}, then 



St^'[3l (/) 



21=22 



fi izi,Z2) h (2:3) [dzx) LP (dz2) ^ idz-i) ; 



if n = 3 and / (zi, 2:2,2:3) = /i (^1,2:2) /2 (23) and a = 1 = {{1,2,3}}, then 

/i (^^i, 22) /2 (23) 95 (dzi) LP {dz2) (p (dzs) . 



I 



21=22=23 



5.6 Chaotic representation 

When 93 is a Gaussian measure or a compensated Poisson measure, multiple stochastic Wiener- 
Ito integrals play a crucial role, due to the chaotic representation property enjoyed by ip. Indeed, 
when Lp is Gaussian or compensated Poisson, one can show that every functional F ((/?) G (P) 
of Lp, admits a unique chaotic (Wiener-Ito) decomposition 



F (^) = E [F i^)] + Y,It ifn) , fn € Ll [ly-) 



(5.45) 



n>l 



where the series converges in (P) (see for instance [16], [36] or [l9]), and the kernels {fn} 
are uniquely determined. Formula (I5.45P implies that random variables of the type In {fn) are 
the basic "building blocks" of the space of square-integrable functionals of Lp. In general, for a 
completely random measure ip, the Hilbert space Cn = {in (/) ■ f & (i^")}, n > 1, is called 
the nth Wiener chaos associated with Lp. We set by definition Cq = M (that is, Cq is the 
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collection of all non-random constants) so that, in (|5.45p . K[F] E Cq . Observe that relation 
(|5.45p can be reformulated in terms of Hilbert spaces as follows: 



oo 



n=0 

2 



where © indicates an orthogonal sum in the Hilbert space L (P, cr (93))- 

Remarks, (i) If 99 = G is a Gaussian measure with non-atomic control z^, for every p > 2 
and every ^ 2, there exists ci universcil coiistctnt Cp^n > 0, such that 



E 



/^(/)r <Cn,pIE /^(/)' ' , (5.46) 



i/p 



tG 



1/2 



V / € (i^") (see [Ml Ch. V]). Moreover, on every finite sum of Wiener chaoses ©^LqC^^ and for 
every p > I, the topology induced by LP (P) convergence is equivalent to the L'^-topology induced 
by convergence in probability, that is, convergence in probability is equivalent to convergence 
in LP, for every p > 1 (see e.g. [112]). We refer the reader to [16], [36] or [751 Ch. 1] for an 
exhaustive analysis of the properties of multiple stochastic Wiener-Ito integrals with respect to 
a Gaussian measure G. 

(ii) The "chaotic representation property" is enjoyed by other processes. One of the most 
well-known examples is given by the class of normal martingales, that is, real- valued martingales 
on having a predictable quadratic variation equal to t. See [16] and [H] for a complete 
discussion of this point. 

When if is Gaussian or compensated Poisson, one can characterize the measures St^''""', when 
vr 7^ 0, that is, the effect of these measures on diagonals. The key fact is the following elementary 
identity (corresponding to Proposition 2 in [106j ). 

Proposition 5.4 Let ip be a good completely random measure. Then, for every n > 2, every 
Ci, C„ C Z^, and every partition tt E V {[n]), 

St^f (Ci X . . • X Cn) 

n Stf[l^ll(Q, x-.-xC,,,) (5.47) 
fe={n,...,i|6|}e7r 

n Stf[l^"((nLliQJx...x(nll,QJ). (5.48) 

fe={ii,...,i|6|}e7r 1^1 ^.^g^ 

Proof. Recall that St = J2(7>tt St ^''"^ > by (j5.29p . To prove the first equality, just observe 
that both random measures on the LHS and the RHS of (j5.47p are the restriction of the product 



measure St^'["l to the union of the sets such that a > tt. Equality (|5.48p is an application of 
(IE2D. 
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5.7 Computational rules 

We are now going to apply our setup to the Gaussian case {ip = G) and to the Poisson case 
{if = N = N — u). We always suppose that the control measure v of either G or N is non-atomic. 
Many of the subsequent formulae can be understood intuitively, by applying the following com- 
putational rules: 



Gaussian case: 



G (dx)^ = V {dx) and G (dx)^ = 0, for every n > 3. (5.49) 



Poisson case: 

{N (dx))'' = {N (dx))'' = N (dx) , for every n>2. (5.50) 

5.8 Multiple Gaussian stochastic integrals of elementary functions 

Suppose (/? is Gaussian. The next result (whose proof is sketched below) can be deduced from 
[TM Example G, p. 1272, and Proposition 2, 6 and 12]. 

Theorem 5.1 Let (p = G be a centered Gaussian completely random measure with non-atomic 
control measure u. For every n > 2 and every A £ Zi, 

Stf '["1(^ X . . . X A) 4 (^) = I ° ""-l (5.51) 

n times 

(the measure (•) is called the diagonal measure of order n associated with G). More 
generally, for every n > 2, a £ V {[n]) and Ai, ...,An G 2,^, 

Stg"l (Ai X ■ • • X An) 

_ J 0, i/36 G (T : |6| > 3 

\ Ub={i,j}ea'^i^^'^'^j)Ue=iG{Aj,) , otherwise, 

and 



(5.52) 



St^'W (^1 X . • • X An) 
^ f 0, if3bGa:\b\>3 

\ Ub={^,J}e. ^ n Aj) St ^'['1 {Aj, X . . • X %) , otherwise, ^ ' ' 

where ji, ...,jk are the singletons contained in a\{b ^ a : \b\ = 2}. 

Proof. Relation (|5.5ip is classic (for a proof, see e.g. [106^ Proposition 6]). Formula (15.52P 
is obtained by combining (j5.5ip and (j5.47p . To prove ()5.53p . suppose first that 3b € a such that 
\b\ > 3. Then, by using Mobius inversion ()5.34p . 

St^'N {Aix...xAn) = Y,l^ P) St>r (Ai X ■ • • X A„) = 0, 

cr<p 

where the last equality is due to (|5.52p and to the fact that, if p > o" and a contains a block with 
more than two elements, then p must also contain a block with more than two elements. This 
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proves the first line of (j5.53p . Now suppose that all the blocks of a have at most two elements, 
and observe that, by Definition H] and (|5.7p . 

k 

llG{Aj,)=St^f\Aj,x..-xA,,). 

£=1 

The proof is concluded by using the following relations: 
St^'N {A,x-.-xAn) = '«)St>r (^1 X ... X An) 

W u{A,r\Aj)Y^i{a,p) W v{ArnAi)x 

fe={jj}gCT cr<p b={r,Z}Gp\o- 

xSt^Q X ... X j4j^)l||jj} jj^j are the singletons of pjj 

where we write h = {r, /} G p\a to indicate that the block 6 is in /? and not in a (equivalently, h 
is obtained by merging two singletons of a). Indeed, by the previous discussion, one has that the 
partitions p involved in the previous sums have uniquely blocks of size one or two, and moreover, 
by Mobius inversion, 

Y,ti{<y,p) n K^n^,) xStJf<(^nX---x^ 

^^m/ {{2i},...,{im} are the singletons of p} 

(T<p b={r,l}&p\a 

= X] ^(^*' n ^ ^ St^y"'\Ai^ X ... X are the singletons of p*} 

a*<p* fe={r,/}Gp* 

= ^MO,P*)Stg?](A,, x...xA,J 

0<p* 

= St?'' \Aj^ X . . . x ^jj^), 

where a* and p* indicate, respectively, the restriction of cr and pto {ji, jfc}, where {ji}, {j^} 
are the singletons of a (in particular, a* = 0). Note that the fact that p.{(J,p) = fi{a*,p*) = 
p{0, p*) is a consequence of (\2.7h and of the fact that p has uniquely blocks of size one or twol!] 
■ 

Examples, (i) One has St^^"' {Ai x ■ ■ ■ x An) = G (Ai) ■ ■ ■ G{An), which follows from 

(j5.52p . since = {{1} , {f^}}, but also directly since the symbol " > " entails no restriction 
on the partition. In integral notation (/ is always supposed to be elementary) 

Stjf 1 (/) = / / (zi, Zn) G (dz,) . . . G (dZn) . 

On the other hand, there is no way to "simplify" an object such as St?''"^ {Ai x ■ ■ ■ x An), wich 
is expressed, in integral notation, as 

Stf = (/) = / f{zi,...,Zn)G{dz,).-.G{dZn). 

"Thanks to F. Benaych-Georges for pointing out this argument. 
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(ii) For n > 3, one has 

St^f (Ai X • • ■ X A) = Stf iAiX---xAn) = 0, 
since the partition 1 contains a single block of size > 2. In integral notation, 

Stf (/) = / / (^1, Zn) G (dzi) ■■■G (dZn) = 0. 

When n = 1, however, one has that 

Stf W (/) = ^ / (z) G [dz) -^{o,J^ fdv^ . 

When n = 2, 

Stf''k/)= / f{z,z)i^idz). 

(iii) Let ra = 3 and a = {{1} , {2, 3}}, then St^'^^^ {Ai xA^x A^) = 0, and therefore 

Stjf 1 (^1 X ^2 X A3) 
= St^'[3l (Ai X ^2 X A3) + Stf (Ai X A2 X A3) 
= St^'1^1 (Ai X A2 X A3) = G (Ai) V (A2 X A3) . 

In integral notation: 

St?f (/) = St^'Pl (/) = / / f{z,z,x)u{dz)G{dx). 

J Z JZ 

(iv) Let n = 6, and 0- = {{1, 2} , {3} , {4} , {5, 6}}. Then, 



whereas 



Stjf (Ai X ... xA^) = v (Ai n A2) V (As n Ag) G (A3) G (A4) , 

St^'1^1 (Ai X ... X Ae) = (Ai n A2) v (A5 n Ag) St^'^'l (A3 x A4) . 
These relations can be reformulated in integral notation as 

Stjf (Ai X ... X Ae) 

/ {x, X, y, y, w, z) v (dx) v (dy) \ G (dw) G (dz) 




iz JZ Uz JZ 
St^'l^l (Ai X ... X Ae) 



/ (x, X, y, y, w, z) v [dx) u {dy) \ G {dw) G {dz) . 

w^z VJZ JZ ) 

(v) Let n = 6, and 0- = {{1, 2} , {3} , {4} , {5} , {6}}. Then, 

St^f (Ai X ... xAe) = iy (Ai n A2) G (A3) G (A4) G (A5) ^(Ae) 

and also 

St^'I^l (Ai X ... xAe)=iy (Ai n A2) St^'^ (A3 x A4 x A5 x Ag) . 
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5.9 Multiple stochastic Poisson integrals of elementary functions. 

A result analogous to Theorem 15.11 holds in the Poisson case. To state this result in a proper 
way, we shall introduce the following notation. Given n > 2 and o" E "P [n], we write 

Bi ((7) = {6 € a : |6| = 1} , 

to denote the collection of singleton blocks of a, and 

Bs (a) = {b = {ii, G a : £ = [6[ > 2} (5.54) 

to denote the collection of the blocks of a containing two or more elements. We shall also denote 
by PB2 (fx) the set of all 2-partitions of B2 (cj), that is, PB2 (cr) is the collection of all ordered 
pairs {Ri; R2) of non-empty subsets of B2 [a) such that -Ri,i?2 C B2 (cr), Ri H R2 = 0, and 
i?i U i?2 = B2 (cr); whenever B2 (o") = 0, one sets PB2 (cr) = 0. We stress that PB2 (cr) is a 
partition of B2 (cr); the fact that B2 (a) is also a subset of the partition a should not create 
confusion. 

Examples, (i) Let n = 7, and cr = {{1, 2} , {3, 4} , {5, 6} , {7}}. Then, 

B2 (cr) = {{1,2}, {3, 4}, {5, 6}} 

and PB2 (cj) contains the six ordered pairs: 

({{1,2},{3,4}};{{5,6}}) ; ({{5, 6}} ; {{1, 2} , {3, 4}}) 
({{1,2},{5,6}};{{3,4}}) ; ({{3, 4}} ; {{1, 2} , {5, 6}}) 
({{3,4},{5,6}};{{1,2}}) ; ({{1, 2}} ; {{3, 4} , {5, 6}}). 

For instance, the first ordered pair is made up of Ri = {{1, 2} , {3, 4}} and R2 = {{5, 6}}, whose 
union is B2 (cr). 

(ii) If n = 5 and a = {{1, 2, 3} , {4} , {5}}, then Bi (a) = {{4} , {5}}, B2 (a) = {{1, 2, 3}} 
and PB2 (cr) = 0. 

(iii) If n = 7 and = {{1, 2, 3} , {4, 5} , {6} , {7}}, then Bi (cr) = {{6} , {7}} and B2 (a) = 
{{1, 2, 3} , {4, 5}}. Also, the set PB2 (cr) contains the two ordered pairs 

({1,2, 3}; {4, 5}) and ({4, 5} , {1, 2, 3}) . 



We shall now suppose that 99 is a compensated Poisson measure. 

Theorem 5.2 Let ip = N be a compensated Poisson measure with non-atomic control measure 
V, and let N {■) = N (•) -\- v {■). For every n > 2 and every A E Z^, 

Stf •t"^ ( A X ■ • • X A) ^ (A) = N (A) (5.55) 

n times 

(An (•) is called the diagonal measure of order n associated with N). Moreover, for every 
Ai, An E Zi,, 

St^'"l {AiX---xAn) = N{Ain---nAn). (5.56) 
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More generally, for every n > 2, a ^ V ([n]) and Ai, ...,An € 2u> 

Stg"] (Ai X . . . X A^) (5.57) 

k 

n NiA,n---nAi,)l[NiA,J, 

b={ii,...,ie}eB2ia-) a=l 

where {{ji} , {jk}} = Bi {a), and also 

St^'W (Ai X • . . X (5.58) 
= ^ n 1^(^*1 n---n^ij X (5.59) 

X Stf ( X (^e, n . • • n A, J xA,,x.-.x A A (5.60) 

^g^T^JlB^Ml+fc]/" X {Ai,n---nAi^)xA,,x.--xAA (5.61) 

+ H u{A,n---nAi^)St^'^''^{A,,x---xA,^), (5.62) 

6={ii,...,j£}eB2{(T) 

where {{ji} , {jk}} = Bi (o") and where (by convention) T,^ = 0, = and St^''°' = 1. 
j4/so, \R2\ and |B2 (o-)[ stand, respectively, for the cardinality of R2 and B2 (a), and in formula 
\5. 60\) we used the notation 

X {Ae, n • • -DAeJ = X (neeb^e) = (HeGfei^) X " " " X (neG6|«,| ^le) , 

where bi, ^-^ some enumeration of R2 (note that, due to the symmetry of ^\/^^'^^^^\ the 

choice of the enumeration is immaterial). The summand appearing in formula Ii5. 61\) is defined 
via the same conventions. 



Remarks, (a) When writing formula (j5.6ip . we implicitly use the following convention: if 
B2 (c) = 0, then the symbol X (Ai-^ fl • • • fl Ai^) is immaterial, and one should read 

b={jl,...,if}eB2(o-) 

X (Ai^ n • • • n AjJ X Aj^ X ■ ■ ■ X Aji^ = Aj^ X ■ ■ ■ X Aj^ = Ai x ■ ■ ■ x An, (5.63) 

fe={n,...,i^}GB2(o-) 

where the last equality follows from the fact that, in this case, k = n and {ji, Jfc} = {1, n} = 
[n]. To see how the convention (15.63P works, suppose that B2 (fx) = 0. Then, PB2 (fx) = and 
consequently, according to the conventions stated in Theorem 15. 2| the lines (I5.59p - ()5.60p and 
(|5.62p are equal to zero (they correspond, respectively, to a sum and a product over the empty 
set). The equality (I5.58P reads therefore 

StJ'W {Aix---xAn) = St f '["1 ( X {Ai, n---nA^)xAj,x---x A A . (5.64) 

U \b={il,...,iJeB2(cr) / 
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By using (j5.63p one obtains 

stf ( X M,, n . • • n A,,) X X ... X A,\ 
\fe={ji,...,j^}eB2{o-) / 

= Stf {A,, X ... X A, J = Stf N X ... X AO , 

entailing that, in this case, relation (|5.58p is equivalent to the identity St^''*^' = St^'^"^. 

(b) If A; = (that is, if Bi (cr) equals the empty set), then, according to the conventions 

stated in Theorem 15.21 one has St^''^' = St^'''^^ = 1. This yields that, in this case, one should 
read line (j5.62p as follows: 

n i^(A,,n...nA,JStf'['=](A,, X...X 

6={ii,...,i^} eB2(o-) 

W v{Ai^r^■■■nAi;). 

b={h,...,ie} eB2(cr) 

(c) If = 0, one should also read line (|5.60p as 

stf 'tl^^l+'^l { X {A,, n ... n A, J X A,, X ... X aA 
= stf'tl^^llf X {A,,n---nA 

and line (j5.6ip as 

g^7^,[|B2(<x)|+fc] / ^ ^ . . . ^ X X ... X A,^ 



emJ I 1 



\b={h,...M<^B2{ay "J 



Proof of Theorem 15.21 To see that (|5.56p must necessarily hold, use the fact that u is 
non-atomic by assumption. Therefore, 



St 



N,[n\, 



^ (Ai X . . . X A„) = St^™(Ai n . . . n A„) + v{Ai n . . . n A„) 
= N{Ai r\ - ■ ■r\An) + v{Ai n . . . n A„) = N{Ai n . . . n An). 

Observe also that (j5.56p implies (j5.55p . Equation (j5.57p is an immediate consequence of (j5.47p . 
(|5.55p and (|5.56p . To prove (|5.58p . use (|5.57p and the relation = iV + i^, to write 

Stjj"! (Ai X . . . X A„) 



n n 

t=2 b={h,...,ii}&a 



K 

N {Ai, n . . . n Ai^) + u {Ai, n . . . n A^,) ] JJ N (AjJ , 



a=l 
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and the last expression equals 



J2 n i^{Ai,n---nAi^)x 

(Ri;R2)ePB2{<j) b={h,...,ie} eRi 



xSt 



+St 



>o 

7V,[|B2((7)|+fe] 
>0 



X {Ae, n---nAeJxAj,x---x Aj^ 

b={ei,...,em}eR2 



X 



{Ai^ n ■ • • n xAj^x---xA 



+ n 

b={h,...,ie} GB2(<t) 



6={ii,...,if}GB2((7) 

z.(Ain---nA,)St^f (A,,x..-xA,J, 



since St ^^"^ (Ai x ■ • • x A^) = N (Ai)- --N {An). The term before last in the displayed equation 



corresponds to Ri = 0, R2 = B2 (a), and the last term to i?i = B2 (cr) and R2 = 0- By 
definition, these two cases are not involved in PB2 (a). The last displayed equation yields 

St^W (Ai X • ■ ■ X = Stg"! ((^1 X • • ■ X An)lzj}) 

= n iy{Ai,n---nAi^)x 

(ili;il2)ePB2((T) b={h,...,H} eRi 



xSt 



+St 



JV,[[i?2|+fc] 

>o 

JV,[|B2(a)|+fc] 

>6 



X (Aei n • • • n AeJ xAj^X---X Aj^ 

b={ei,...,em}&R2 



<■ \ ^ , S^i^ ^ ■ ■ ■ ^ xAj,x---x Aj^ 



) 

2\B2(<T)\+k 



'^y\R2\ + k 
^0 J 



+ n ^ n • • • n A,) St ([^,, X • • • X 1^.) 

fe={n,...,i^} eB2(<T) 



Since, by definition. 



and 



St 



N\\R2\+k] 



>0 



X (Aei n ■ ■ ■ n A^J X A,-, X ■ • • X % 

6={ei,...,em}GW2 



St 



iV,[|il2|+fc] 

6 



X (Aei n • • ■ n AeJ xAj,X---X Aj^ , , 

b={ei,...,emi&R2 



and 



St 



N,[\B2{a)\+k] 



>0 



X 

b={ii,...,it}e'B2{a) 



{Ai^ n • • • n AiJ X ylj, X • • ■ X 4 



St 



iV,[|B2(a)|+fc] 

6 



L^|B2{<T)|+fe 

6 



X (Ai n ■ ■ • n ^i^) X X • • ■ X Aj^ , , 



St 



AT 



X ■ ■ • X 1 1 



one obtains immediately the desired conclusion. 
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Remark on integral notation. It is instructive to express the results of Theorem 15.21 in 
integral notation. With / (zi, Zn) = g (zi) ■ • • g (zn), formula (15.57P becomes 



/ g (zi) ---g (zn) N (dzi) • • • iV (dzn) 

n / g{zf\N{dz) \ X n g{z)N{dz) 

where k = |Bi ((t)| . Again with / (zi, .., Zn) = g {zi) ■ ■ ■ g (zn), (j5.58p - (l5.62p become 
g{zi) ■ ■ ■ g (zn) N (dzi) ■ ■ ■ N (dzn) 

/ 5(21)'^'' • ■ ■ 9 {z\R^\)'^^^''^^^ g {ziR^i+i) ■ ■ ■ g (ziji^i+k) 



(i?i;i?2)6PB2((T) feG-Ri 
X 



N {dzi) ■ ■ ■ N {dz^R.^\+k) 

+ l{B2H = {fel,...,fe|B2Ml}} 

X / 9 (2:1)''"' ■■■g (^;|B2(<7)|) ' g (z|B2(a)i+i) ■■■g (z|B2Wi+fc) 

iV(dzi)---iV(dz|R^I+,) 
+ n I 9{zfK{dz)x f g{zi)---g{zk)N{dzi)---N{dzk), 



6eB2((T) 
where /c = |Bi {cr)\. 



Examples. The examples below apply to a compensated Poisson measure N, and should 
be compared with those discussed after Theorem 15.11 We suppose throughout that n > 2. 
(i) When a = = {{1} , {n}} one has, as in the Gaussian case, 

Stjf 1 (Ai X . . . X A„) = iV (Ai) • . • TV (An) 

because the symbol " > " entails no restriction on the considered partitions. In integral 
notation, this becomes 



f ' (/) = / / {ZU Zn) N (dzi) --.N {dZn) ■ 



The case of equality ()5.58p has already been discussed: indeed, since a = 0, and according to the 
conventions stated therein, one has that B2 (cr) = PB2 (cr) = and therefore (j5.58p becomes 

an identity given by (|5.62p . namely St^'^"^ (•) = St^'^"^ (•). Observe that, in integral notation, 

g^Af,[n] ^-.-j jg expressed as 

stf'["i 



(/)= / f{zu.:,Zn)N{dzi)---N{dZn) 
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(ii) Suppose now a = 1 = {{1, ...,n}}. Then, ()5.58p reduces to ()5.56p . To see this, note that 
A; = and that B2 (l) contains only the block {1, so that PB2 (o") = 0. Hence the sum 

appearing in (j5.59p vanishes and one has 

Stf '["1 (Ai X • • • X A„) = St f '['1 n • • • n A) + (^1 n • • • n A) 
= N{Air\---nAn) + i^{Ain---nAn) = N{Air\---nAn). 

In integral notation, 

Stf["](/) = [ f{zi,...,Zn)N{dzi)---N{dZn) 

Zl=--- = Z„ 

f{z,...,z)N{dz). 



This last relation makes sense heuristically, in view of the computational rule 

(iV {dx)y = {N {dx)f - 2N (dx) V (dx) + {v {dx)f = N (dx) 



since {N (dx))'^ = N (dx) and v is non-atomic. 

(iii) Let n = 3 and a = {{1} , {2, 3}}, so that B2 (cr) = {{2, 3}} and PB2 (fj) = 0. According 
to (f537|) . 

S4f {Ai X A2 X ^3) = iV (Ai) N {A2 n ^3) . (5.65) 
On the other hand, (j5.58p yields 

StJ'[3] {Ai XA2X As) = Stf '['1 {Ai X {A2 n A3)) + N {A,) v (^2 n A^) . (5.66) 
In integral form, relation ()5.65p becomes 

Sttfif)= I I f{zuZ2,Z2)Nidzi)N{dZ2), 



Z JZ 



and (15.661) becomes 



Stf ■['!(/) = / /(zi,Z2,Z3)iV(dzi)iV(dZ2)iV((iZ3) 
f{zi,Z2,Z2)N{dzi)N{dz2) 

Zl^Z2 



+ f {zi,Z2,Z2)N {dzi)v{dz2) . 
Jz-^ 

This last relation makes sense heuristically, by noting that 

N {dzi) N {dz2) N {dz2) = N (dzi) N {dz2) 

= N {dzi) N {dz2) + N {dzi) u {dz2) . 

We also stress that St^'''^^ (/) can be also be expressed as 

St^[3](/) = /2^(50 + /f (52), (5.67) 
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where gi{x,y) = f{x,y,y) and g2{x) = / f {x,y,y) u (dy). The form (j5.67p wih be needed 
later. Since, by (|536]) . St^''^' (^i x A2 x ^3) = iV {Ai n ^2 n A3) and since, for our a, one has 
St>^^^' = St^'^^^ + St^''^^, one also deduces the relation 

N {Ai) N {A2 n A3) = St^''^^ (Ai X {A2 n A3)) + iv (Ai n ^2 n A3) + N {Ai) v {A^ n A3) , 

or, equivalently, since N = N + u, 

N (Ai) N {A2 n A3) = St^t^l {Ai X {A2 n A3)) + (Ai n ^2 n A3) + iv (Ai n A2 n A3) . (5.68) 



We will see that (15.68P is consistent with the multiplication formulae of next section, 
(iv) Let n = 6, and cr = {{1, 2} , {3} , {4} , {5, 6}}, so that 

B2 (a) = {{1,2}, {5, 6}} 

and the class PB2 (cr) contains the two pairs 

({1,2}; {5, 6}) and ({5, 6} ; {1, 2}) . 

First, (15.57P gives 

Stjfl (Ai X ... xAe) = N (Ai n A2) N (A5 n A^) N {A3) N (A4) . 



Moreover, we deduce from (j5.58p that 



Stf '[6] (Ai X ... X Ae) = iy{AinA2)St^^^'^{{A,nAe)xA3xA^) 

+u (As n Ae) St^'t'J ((Ai n A2) X A3 X A4) 



+StQ''^"J ((Ai n A2) X (As n Ae) x A3 x A4) 
+v (Ai n A2) u (As n Ae) Stf '['l (A3 x A4) . 



The last displayed equation becomes in integral form 
St^'I^l (/) 



'2:1=22, 25=2^6, Z-i^Zi 

f{zu...,ze)N{dzi)---Nidze) 

23^25, Zi^Z5 

f {w, w, X, y, z, z) V (dw) N (dx) N (dy) N (dz) 
+ f{w, w, X, y, z, z) N (dw) N (dx) N (dy) v (dz) 

+ / f {w,w,x,y, z, z) N (dw) N (dx) N (dy) N (dz) 

f {w, w, X, y, z, z) V {dw) N (dx) N (dy) v [dz) . 

w^Xyty^z 
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Indeed, let us denote the RHS of the last expression as (I) + {II) + (///) + {IV). For (/) and 
{II), we use (I539]l - (f5:60]l with Ri = {{1,2}} and R2 = {{5,6}} and k = 2, which corresponds 
to the number of singletons {3} , {4}. For {III), we use (|5.6ip . with A; + IB2 ((t)| = 2 + 2 = 4, 
and B2 {a) = {{1, 2} , {5, 6}} . For (f02]) we use A: = 2 and our B2 {a). 

(v) Let n = 6, and cr = {{1, 2} , {3} , {4} , {5} , {6}}. Here, B2 {a) = {{1, 2}} and the class 
PB2 (cr) is empty. Then, 

Stff (^1 X ... xAe)=N {Ai n A2) N {A3) N (A4) N (A) N {A^) , 

and also 

St^[6] (^1 X ... X Ae) = u (Ai n A2) Stf (^3 X ^4 X ^5 X ^6) 



In integral form, 

St?'!*^] (/) 



+St^W ((^^ n A2) X A3 X X ^5 X Ae) . 
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/ 21=2:2, f{zi,Z2,Z3,Z4,Z5,ZQ)Y\N{dZj) 
J zij^Zj,j=3,...,6 fj^ 

L^^Zj, j=3,...,6 f (^1' ^1' 2^3, Za, 2:5, Zq) V {dzi) N {dZj) 
Ziyiz-,'3<i^j<6 3=3 

+ L^2^., j=3,...,6 (^1' ^1' ^3, Z4, Z5, ze) N {dzi) Y[ N (dzj) . 

Zi^z-,'3<i^j<6 3=3 



Corollary 5.1 Suppose that the Assumptions of Theorem \5.S\ hold. Fix a G and assume 

that \b\ > 2, for every 6 G o". Then, 



E 



StJ'N X • • • X A„)] = n n ^ (^^-1 n • • • n yl,„) . 

™=2fcG{jl,.--Jm}ecr 



(5.69) 



Proof. Use (j5.58p - (|5.62p and note that, by assumption. A; = (the partition a does not 
contain any singleton {j}). It follows that the sum in ()5.59p vanishes, and one is left with 



E 
E 



StJ'W (Ai X ■ ■ • X An) 



St 



Ar,[fc+|B2((T) 

6 



X {Ai, n • • • n Ai.) -x Aj, X • • • X Aj. 



+ Jl i/(Ai, n • • ■ n 

6={il,...,ijGB2{cr) 

JJ V {Ai^ n • • • n Ai, 



b={jl,...,if}eB2{o-) 

which is equal to the RHS of (I5.69p . 
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6 Multiplication formulae 



6.1 The general case 

The forthcoming Theorem 16.11 apphes to every good completely random measure (/?. It gives a 
universal combinatorial rule, according to which every product of multiple stochastic integrals 
can be represented as a sum over diagonal measures that are indexed by non-flat diagrams (as 
defined in Section 14. ip . We will see that product formulae are crucial in order to deduce explicit 
expressions for the cumulants and the moments of multiple integrals. As discussed later in this 
section, Theorem 16.11 contains (as special cases) two celebrated product formulae for integrals 
with respect to Gaussian and Poisson random measures. We provide two proofs of Theorem 
I6.lt the first one is new and it is based on a decomposition of partially diagonal sets; the second 
consists in a slight variation of the combinatorial arguments displayed in the proofs of [106^ Th. 
3 and Th. 4], and is included for the sake of completeness. The theorem is formulated for simple 
kernels to ensure that the integrals are always defined, in particular the quantity St^'^"', which 
appears on the RHS of (16. 2p . 

Theorem 6.1 (Rota et WaUstrom) Let ip be a good completely random measure with non- 
atomic control u. For ni,n2, ■■■,nk > 1, we write n = ni + • • • + Uk, and we denote by vr* the 
partition of [n] given by 

IT* = {{1, , {ni + 1, + 712} , {ni + ... + n^-i + 1, . (6.1) 

Then, if the kernels /i, fk are such that fj G f^^o (i^"^) (j = 1, k), one has that 

(6.2) 



UUA (/,)=n •=! St^^''"^l (/,)=E.eP(N):.A..=6 St^'^'^' (/l ®0 /2 00 • • • 00 fk), 



where, by definition, the function in n variables fi iX)o /2 00 • ■ ■ 00 /fc ^ (i^") is defined as 

k 

fl 00 /2 00 • • • 00 fk {X1,X2, ...,X„) = Y[fj {xn-,+...+nj.i+l,-nXm+...+nj) , (riQ = 0). (6.3) 

Proof. (First proof) From the discussion of the previous section, one deduces that 

n st^^'t-^i (/,) = st^f [(/i 00 • • • 00 fk) lA^] , 

where 

A* = {{zi, Zn) e Z"- : Ziy^ Zj, Mi 7^ j such that i j} , 
that is. A* is obtained by excluding all diagonals within each block of tt*. We shall prove that 

A*= U (6.4) 

aeV([n])■.a^■K*=Q 

Suppose first a is such that o" A vr* = 0, that is, the meet of a and vr* is given by the singletons. 
For every {zi, Zn) € the following implication holds: if i 7^ j and i ^t^* j, then i and j are 



53 



in two different blocks of cj, and therefore Zi 7^ Zj. This imphes that Z" C A* . For the converse, 
take {zi, Zn) S A* , and construct a partition a & V {[n]) hy the fohowing rule: i ~cr j if and 
only if Zi = Zj. For every pair i / j such that i j, one has (by definition of ^4*) Zi ^ Zj, so 
that o" A vr* = 0, and hence ()6.4p . To conclude the proof of the theorem, just use the additivity 
of St^'l"^ to write 

Stjf [(/i C5o • • ■ ®o /fe) 1a*] = Yl St^f [(/i ®o ■ • • ®o A) Iz,"] 

(TA7r*=0 
(TA7r*=0 

by using the relation St^'l"^ [(■) Iz^] = St^'t"' [•]. 

{Second proof - see jllOGf ) This proof uses Proposition 12.11 and Proposition 12.21 To simplify 
the discussion (and without loss of generality) we can assume that ni > n2 > ■ ■ • > Uk- For 
j = 1, k we have that 

st^'f"^' (/.) = E /^(6,cx)StJ^](/,), 

aGP([nj]) 

where we have used (I5.34p with vr = 0. From this relation one obtains 

nst-["^](/,)= E ••• E riM(o,-.)sc'i;^^(/,) 

i=l <TiG-P([ni]) <xfceP([nfc])i=l 

= E M(6,p)St^'^l(/i0o---®oA), (6.5) 

peV([n]):p<TT* 

where vr* is defined in (j6.ip . To prove equality (j6.5p . recall the definition of "class" in Section 
12.31 as well as the last example in that section. Observe that the segment [O, vr*] has class 
(ni, fifc), thus yielding (thanks to Proposition 12. 2p that [0,vr*] is isomorphic to the lattice 
product of the V ([nj])'s. This implies that each vector 

(ai,...,cTfc) GP([ni]) x---xV{[nk]) 

has indeed the form 

{ai, ...,ak) = ^"^ ip) 

for a unique p € [O, vr*] , where ij) \s a bijection defined as in ()2.16p . Now use, in order. Part 2 
and Part 1 of Proposition 12.11 to deduce that 

k 

J]//(6,(j,) =/i(6,(ai,...,afc)) = /u (6, (p)) =/i(6,p). (6.6) 

j=i 

Observe that 

6={{l},...,{n,}} in /i(6,cT,), 

whereas 

6 = {{l},...,{n}} in /x(6,p). 
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Also, one has the relation 

k 

n st><E;^"' (/.) = st^f (/i ®o • ■ • ®o A) , (6.7) 

(by the definition of St^'j;"^ as the measure charging all the diagonals contained in the diagonals 
associated with the blocks of the aj {j = l,...,k)). Then, (j6.6p and (j6.7p yield immediately 
(|6.5p . To conclude the proof, write 

^ ;u(6,p)St^'["l(/i®o---0o/fc) 

p€P{[n]):p<TT* 

E (0' Z') E '"^ (/i 00 • • • C5o A) 

pe'P([n]):p<7r* 7>P 

= J] St^'W (/^ . . . ^ ^(6,^). 

7G'P(M) 0<p<7r*A7 



Since, by ([mjl . 



0<p<7r*A7 

relation (16.21) is obtained. 



E ^(0'/') = { 



if 7r*A7^6 

1 if 7r*A7 = 0. ' 



Remark. The RHS of ()6.2p can also be reformulated in terms of diagrams and in terms of 
graphs, as follows: 

^ St^'N (/i 00 /2 00 • • • 00 /fc) , 

(TG'P([n]):r(7r*,cr) is non-flat 

where F (vr*, a) is the diagram of (vr*, a), as defined in Section I4.H or, whenever every F (vr*, a) 
involved in the previous sum is Gaussian, 

St^'N (/i ®o /2 00 • • • 00 fk) . 

aE'P{[n]):T{n* ,a-) has no loops 

where T{TT*,a) is the graph of (vr*,(7) defined in Section HT3l This is because, thanks to Propo- 
sition [4Tl the relation tt* Aa = indicates that F (vr*, cr) is non-flat or, equivalently in the case 
of Gaussian diagrams, that F (vr*, a) has no loops. 

Examples, (i) Set k = 2 and ni = n2 = 1 in Theorem 16.11 Then, n = 2, V ([2]) = |0, l} 
and vr* = {{1},{2}} = 0. Since A 1 = 0, ()6.2p gives immediately that, for every pair of 
elementary functions /i,/2. 

If (/i) X If ih) = St^'l'l (/i 00 /2) + Stf (/i ^0 h) 

= I^ifi^of2) + Stf^^ih^of2), (6.8) 

Note that, if (/? = G is Gaussian, then relation (|5.5ip yields that 

Stf '['1 (/l 00 /2) =J^fl {Z) f2 (Z) V {dz) , 
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so that, in integral notation 

i?{fi)y<i^{h)-- 



fi (zi) f2 iz2) G (dz^) G idz2) + / /i (z) h (z) V (dz) . 



On the other hand, if ip is compensated Poisson, then St^''^' (/i ®o f2) = fi (z) /2 (z) N (dz), 
so that, by using the relation N = N + i/, (j6.8p reads 



If (/l) X /f (/2) = (/i 00 /2) + / /l (^) /2 {Z) N (dz) 



tN 



rN 



+ jji{z)h{z)v{d 



z) 



h{zi)f2{z2)N{dzi)N{dZ2) 



+ / /l {Z) f2 (Z) N (dz) + / /l (Z) f2 (Z) V (dz) 
J z J z 

I§ ifl ®0 /2) + (/1/2) + / /l (Z) f2 (Z) V (dz) 



(ii) Consider the case k = 2, rii = 2 and n2 = 1. Then, n = 3, and tt* = {{1, 2} , {3}}. There 
are three elements cJi, ct2, CT3 G P ([3]) such that cji A vr* = 0, namely cJi = 0, a"2 = {{1, 3} , {2}} 
and CJ3 = {{1} , {2, 3}} . Then, (|6.2p gives that, for every pair /i G £^<j^o (i^^) , f2 ^ £ (i^), 



/2^(/l)x/f (/2) = Stg^'[=^](/i0o/2) + St^f (/i0o/2)+St^fl(/l®o/2) 
= St,^'[=^] (/i 00 /2) + 2St^'[3l (/i 00 /2) , 



where we have used the fact that, by the symmetry of /i, St^'}^^ (/i 0o /2) = St^g'^^ (/i 0o /2)- 
When = G is a Gaussian measure, one can use (|5.53p applied to cj2 to deduce that 



G 



h{;z)f2{z)u{dz) 



or, more informally. 



St^'f'l (/10O/2) 




z Jz 



h{z\z)f2{z')u{dz)G{dz'), 



so that one gets 



^2''(/l)xA''(/2) = Sr''^H/l®0/2) + 2l[ 



tG 



G,[3] 



/l(.,z)/2(z)z.((iz) 



+2 



/i (^1, ^2) /2 (^3) G {dzi) G {dz2) G (dzs) 
/i (z', ^) /2 (z) V (dz) G {dz') . 



Z JZ 



When if = N is compensated Poisson, as shown in (|5.67p . formula ()5.58p . applied to a2, 
yields 



St^f^ ifl 00 /2) = Ii 



N 



h{.,z)f2{z)u{dz) 



I? [h ®? /2] 
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where /i 0? ^ {z', z) = fi {z', z) /a {z). 

(iii) Consider the case /c = 3, ni = 77-2 = ^3 = 1. Then, n = 3, and vr* = {{1} , {2} , {3}} = 0. 
For every o" G "P ([3]) one has that o" A vr* = 0. Note also that T' ([3]) = {O, pi, pa, P3; l}, where 

/>! = {{!, 2}, {3}}, P2 = {{1,3},{2}}, /53 = {{1},{2,3}}, 

so that ()6.2p gives that, for every /i, /a, /a G (j^), 

It{h)It{f2)It{h) = St^'[=^l(/i0o/2®o/3) + St^;[3](^^^^^^^^^^) 

+St^'[3l (/i 00 /2 00 /s) + St^^[3] 



In particular, by taking /i = /a = /s = / and by symmetry. 

If = st^'l'l (/ 00 / 00 /) + Stf (/ 00 / ®o /) + 3St^;[3] / 0o /) . (6.9) 

When V? = G is Gaussian, then St^'^^^ = by (l53T]) and St^;^^^ (/ 0o / Oo /) = \\f\? if (/), so 
that ()6.9p becomes 

I? iff = l3{f®0f®0f)+3\\fflfif) 

f (Zi) / iz2) f iz3) G (dz,) G {dZ2) G (dzs) 

-3 / f{zfv{dz) X / /(z)G(dz). 



When ip = N 'ys, compensated Poisson, from (I5.55p . then 

Stf '['1 if^of0of) = I f [zf N (dz) = if {f) + jj^ (z) V (dz) 
by ()5.67p . and also 

St (/ 00 / 00 /) = ll/f If (/) + li {f 00 /) , 
where p 0o / {z, z') = (z) / (z'), so that (|6.9p becomes 

I? iff = liif0of0of) + lHf)+ [ fi^)''idz) 

Jz 

+^\\f\\'ihf)+iHf ^0 /) 

/ (^1) / {Z2) f (zs) N (dzi) N {dz2) N (dzs) 
+ Jj (zf (iV + I.) (dz) + 3 ^ / (zf V (dz) ^ j^fiz)N (dz) 

+ 11 f (Zi) f {Z2) N (dzi) N {dZ2) . 

J J Zl^Z2 

General applications to the Gaussian and Poisson cases are discussed, respectively, in Sub- 
section 16.41 and Subsection 16. 5[ 
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6.2 Contractions 

As anticipated, the statement of Theorem 16.11 contains two well-known multiplication formulae, 
associated with the Gaussian and Poisson cases. In order to state these results, we shall start 
with a standard definition of the contraction kernels associated with two symmetric functions 
/ and g. Roughly speaking, given f £ L'^ (i/P) and g £ Li {v'^), the contraction of / and g on 
ZP+q-r-i = 0, g A p and / = 1, r), noted / 4 g, is obtained by reducing the number of 
variables in the tensor product / (xi, ■■■■^Xp) g (xp+i, Xp+g) as follows: r variables are identified, 
and of these, / are integrated out with respect to v. The formal definition of /^J.fl' is given below. 

Definition 7 Let v he a a-finite measure on {Z, Z). For every g,p > 1, / € (j^^); 5 € (i/"?) 
(not necessarily symmetric), r = 0, q Ap and I = 1, r, the contraction (of index (r, I)) of f 
and g on Z^^''^'"^', is the function f *l g ofp + q — r — I variables defined as follows: 

/*r 5(71) • • • ,7r-«,*l, • • • ,*p-r,Sl, • • • , Sg-r) 

/(zi,...,Zi,7i,...,7r_z,ti,...,tp_r) X (6.10) 
X g{zi, ...,zi,ji,.. . ,7r-z,si, . . .,Sq-r)i^'' {dzi...dzi) . 



and, for I = 0, 



/ *r 9{ll, . . . , 7r, il, • • • , ip-r, Si, ... , Sq^r) (6.11) 
/(7I, . . . ,7^,ii, . . . ,tp-r)g(^l, ■ ■ . ,7r,Sl, • • • ,Sg-r), 



so that 



/*o 5(*i, . . . ,ip,si, . . . ,Sg) = /(ti,. . . ,tp)g{si, . . .,Sq). 
For instance, if p = q = 2, one gets 



f4g{j,t,s) = f{i,t)g{^,s), f4g{t,s)= f{z,t)g{z,s)v{dz) (6.12) 

Jz 

f49{l) = [ f{z,^)g{z,^)v{dz), (6.13) 
Jz 

1*2 9 = / / f izi,Z2)gizi,Z2)iyidzi)i^{dz2) . (6.14) 
Jz Jz 

One also has 

f -kl g{xi,...,Xp+g-2T) (6.15) 

f {Zi, Zr, Xi, Xp_r) 9 {Zl, Zr, Xp_r+1, Xp+q-2r) (dzi) ■ ■ ■ U (dZr) , 



IZ^ 

but, in analogy with 16.3\) . we set -k^ = ®r, o-nd consequently write 

f*r9 {Xi, Xp+g_2r) = f (S>r9{xi, Xp+g^2r) , (6.16) 

so that, in particular, 

f*o9 = f®o9- 
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The following elementary result is proved by using the Cauchy-Schwarz inequality. It ensures 
that the contractions of the type (j6.16p are still square-integrable kernels. 

Lemma 6.1 Let f ^ LP' {u^) and g & L'^ i'^'^)- Then, for every r = 0, ...,p A q, one has that 



Proof. Just write 

{^j f {ai,...,ar,Zi,...,Zp-r) 



L 



ZP+q-2r 



2;p + q-2r 

g (ai, Or, Zp-r+l, Zp+q-r) (dai, ...dttr)] U^^'^''^'' {dzi , dZp+q-r) 



6.3 Symmetrization of contractions 

Suppose that f G L'^ {yP) and g G L^ i'^'^)^ and let " ~ " denote symmetrization. Then f = f 
and g = g. However, in general, the fact that / and g are symmetric does not imply that the 
contraction / (8)^ (7 is symmetric. For instance, ii p = q = 1, 

{s, t) = l[f (s) 9{t)+g (s) f (t)] ; 

if p = g = 2 

f (^1 gis,t) = - / [/ {x, s) g (x, t) + g (x, s) f (x, t)] v (dx) . 



z 



2 

In general, due to the symmetry of / and g, for every p,q > 1 and every r = 0, ...,p Aq one has 
the relation 



f0rg{tl,:;tp+g-2r) = ^p+q-2r^ ^ 

\ p—r J 



X 

l<ii<--<ip-r<P+c(— 2r 

where we used the shorthand notation 

= {til, ■■■,ti^_^) 

^{h,...,ip^rT = {h, ■■■,tp+q-2r)\{tii, ■■■,tip_^) 

a.r = {ai,...,ar) 
{da.r) = {dai, ...,dar) ■ 

Using the definition (j6.10p . one has also that f g indicates the symmetrization of / *^ g, 
where I < r. For instance, if p = 3, g = 2, r = 2 and I = 1, one has that 

/ *r 9 (s> t) = f A9is,t) = j f (z, s, t) g (z, s) v (dz) , 

59 



z 



and consequently, since / is symmetric, 

/ 9 (s, = / *2 5 (■?, t) = ^ / [/ {z, s, t) g (z, s)+ f {z, s, t) g {z, t)] v (dz) . 



6.4 The product of two integrals in the Gaussian case 

The main result of this section is the following general formula for products of Gaussian multiple 
integrals. 

Proposition 6.1 Let ip = G he a centered Gaussian measure with a-finite and non-atomic 
control measure v. Then, for every q,p > 1, f £ (u^) and g G (^'^); 

pA? / \ / \ 

if) (9) = E [r) (r J ^^^^^'^ i^') ' ^^'^^^ 

where the symbol (~ ) indicates a symmetrization, the contraction f ®r 9 is defined in i6.1b]} . 
and for p = q = r , we write 

Iq {f®^9 

= f®r9=l f {zi,...,Zp)g{zi,...,Zp)u{dzi) ■ ■ ■u{dzp) 
= if,9)L2{uP)- 

Remark. Since, in general, one has that I^ih) = W (see formula ()5.43p l. one could 
dispense with the symmetrization " ~ " in formula (j6.17p . 

Proof of Proposition [HTTl We start by assuming that / G Sgfl (^^) and g E f^^o and 
we denote by vr* the partition of the set + (7] = {1, ...,p + q} given by 

vr* = {{l,...,p},{p+l,...,p + q}}. 

According to formula (j6.2p 



I^if)I^i9)= E St^'N(/®off). 

o-e'P([p+cj]):crA7r*=0 

Every partition cf £ V {[p-\- q]) such that o" A vr* = is necessarily composed oi r {0 < r < pAq) 
two-elements blocks of the type {i,j} where i G {1, and j £ {p + ^, ---jP + q}, and p+q — 2r 

singletons. Moreover, for every fixed r G {i), ...,p /\q}, there are exactly ^^-{^^ partitions 

of this type. To see this, observe that, to build such a partition, one should first select one 

of the (^) subsets of size r of {!,..., p}, say Ar^ and a one of the y\ subset of size r of 



{p + + say Br, and then choose one of the r! bijections between Aj. and B^- When 

r = 0, and therefore <t = 0, one obtains immediately 

St^'[^+^1 (/ 00 9) = Stf t^+'^J (T^g) = I^^, [f^g) , 
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where the first equahty is a consequence of the symmetry of St?'^"^ (see Proposition 15. 3p . On the 
other hand, we claim that every partition a E V {[p + q]) such that a An* = and a contains 
r > 1 two-elements blocks of the type b = {i,j} (with i G {1, ...,p} and J € {p + 1, ---jP + q}) 
and p + q — 2r singletons, satisfies also 

StG,b+,] ^ Stf^P^'^-''-^ if ®r 9) = I^+g.2r {f^d) ■ (6.18) 

We give a proof of (|6.18p . Consider first the (not necessarily symmetric) functions 

f° = 1Aix-x^p and g° = lAp+ix-xAp+q, 
where Ai G Zi,, I = 1, ...,p + q. Then, one may use (|5.53|) . in order to obtain 

st^'^^'^Hr ^0 9l = n -(^^n^,)St^'[^+^"^^l(A,,x...x^,^,,_,J 

b={i,j}&cr 



\b={i,j}£CT I 



where {{ji} , {jp+g_2r}} are the singletons of a (by the symmetry of St^''^'*''^ ^''^ we can 
always suppose, here and in the following, that the singletons {ji} , {jp-^} are contained in 
{1, and that the singletons {ip-r+i} , {jp+g-2r} are in {p + 1, + q\). For every pair 

of permutations w € S[p] and w' G 6[p+i p+g] (the group of permutations of the set [p+l,p+g] = 
{p + l,...,p + g}), we define /"'"^ = Ia-x-xA- and 5°'"'' = 1a-|-^x-- xA-|,' where A"^ = Ayj(^j), 
j = 1, ...,p (and analogously for w'). In this way, 

St^'[P+'?] (r 00 5°'^"') (6.19) 

= stj'[^---l( n '^i^rnAj')!^^. 

\b={i,j}<^a 



x---xAf xAf x-xA^ 

Jp — r ■'p — r-\- 1 jp+q — 2r 



<b={i,j}ea 



A™ x---xAf xA^ x-xAf 

Jl Jp — r Jp — r-\-\ ■jp-\-q — '2r 



Now write 

and observe that (by using (16.161) ) 



3\ 3p — r 3p — r-\-l 3p-\-q — 2r 



E E n K^^^^^"') V.x-xA- __xA-' ._,.x...xA-',_ ^ =/^r5. 

Since (16.19P gives 



St I E E n "KnAf)! 



Af x-.-xAf xA"' X---XA™ 

Jl Jp — r jp — r + 1 Jp+q — 2r 
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we obtain (j6.18p . so that, in particular, (j6.17p is proved for symmetric simple functions vanishing 
on diagonals. The general result is obtained by using the fact that the linear spaces £sfi {v'^) 
and Egfi {v'^) are dense, respectively, in {u^) and {v'^). Indeed, to conclude the proof it is 
sufficient to observe that, if {fk} C £3,0 {v^) and {gu} C £sfi {v'^) are such that fk — > / in Lg (z^^) 
and gin Ll (i/?), then, for instance by Cauchy-Schwarz, {fk) Ig {gk) Ip (/) Iq {§) in 
any norm (P), s > 1 (use e.g. ()5.46p ). and also 

fk ®r Qk ^ f ®r g 

in Ll so that [f^gk) ^ /p^+,_2r {f^d) m (P). ■ 

Other proofs of Proposition [6TT] can be found e.g. in [39], [16] or [75^ Proposition 1.1.3]. 
Examples, (i) When p = q = 1, one obtains 

I? if) I? (g) = I2 {f^g) + lo {f^g) = I2 {f^g) + (/, g)LH.) > 

which is consistent with (j6.8p . 

(ii) When p = q = 2, one obtains 

I2 if) I2 ig) = I4 {f^g) + ^i2 {f®^g) + (/, <?)l2h • 

(iii) When p = 3 and q = 2, one obtains 

^3"" (/) I2 ig) = I5 {f^g) + (T®^g) + 6/f (/ ®2 g) , 

where f ®2 g iz) = f iz,x,y) g {x,y) u (dx) v (dy) . 

6.5 The product of two integrals in the Poisson case 

We now focus on the product of two Poisson integrals. 

Proposition 6.2 Let ip = N he a compensated Poisson measure, with a-finite and non-atomic 
control measure u. Then, for every q,p > 1, / € £3,0 i'^^) o-^^d g G £sfi {v'^), 

lhf)l!i9) = E^iQ C) E i'^lL-r-A7^9). (6.20) 

Formula i6.20\) continues to hold for functions f ^ L^ (u^) and g ^ L^ {u'^) such that f-k^g G 
L2 (i/9+P-'-'), Vr = 0,...,pAq, Ml = 0,...,r. 

Sketch of the proof. We shall only prove formula (|6.2Up in the simple case where p = q = 2. 
The generalization to general indices p,q > 1 (left to the reader) does not present any particular 
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additional difficulty, except for the need of a rather heavy notation. We shall therefore prove 
that 



r=0 ^ ^ ^ ^ 1=0 



tN 
'4-r 



+4 



+2 



li^ if g) + li^ if 4 g) 
Moreover, by linearity, we can also assume that 

/ = 1AixA2 + 1a2xAi and g = 1bixB2 + ^B2xBi, 

where Ai f] A2 = Bi f] B2 = . Denote by vr* the partition of [4] = {1, 4} given by 

7^* = {{1,2}, {3, 4}}, 
and apply the general result (j6.2|) to deduce that 



(6.21) 

(6.22) 
(6.23) 

(6.24) 



o-g'P([4]):o-A7r*=0 

We shall prove that 

J2 StJ'N(/0o5) = ([622|) + (16231) + (16211). 

o-GP([4]):crA7r*=6 

To see this, observe that the class 

contains exactly 7 elements, that is: 

(I) the trivial partition 0, containing only singletons; 

(II) four partitions ui, ...,cj4 containing one block of two elements and two singletons, namely 

ai = {{1,3}, {2}, {4}}, a2 = {{l,4},{2},{3}} 

as = {{1},{2,3},{4}} and a4 = {{l},{2,4},{3}}; 

(III) two partitions (T5, cTg composed of two blocks of two elements, namely 

a5 = {{l,3},{2,4}} and erg = {{1, 4} , {2, 3}} . 
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By definition, one has that 

Stf["l if 00 9)= l! (7^9), 

giving (I6.22p . Now consider the partition ai, as defined in Point (II) above. By using the 
notation ([53^ . one has that B2 (cxi) = {{1,3}}, IB2 {ai)\ = 1 and PB2 (ai) = 0. It follows 
from formula (j5.58p that 

St?/^1 (/ 00 g) = Stf/^l {{1a,xA, + Ia.xaJ ®o + 

= St^'^ (l(AinBi)xA2xB2 + l(AinB2)xA2xBi + l(A2nBi)xAi XB2 + l(A2nS2)xAixBi) 

+1^ (Ai n St ^'['J (1^2 XB2) + (^1 n B2) St (1a2xbJ 

+1^ (A2 n St ^'['J (1^, XB2 ) + (^2 n B2) St J"-''] (lAi xBi ) . 



Observe that 



'0 



St^ ' (l(AinBi)xA2xB2 + l(AinB2)xA2xBi + l(A2nBi)xAixB2 + l(A2nB2)xAixBi; 



and moreover, 

1/ (.4i n Bi) St f '['1 (IA2XB2) + 1^ (^1 n B2) St f '['1 (1a2xbJ + 
u {A2 n i?i) stf '['i (IA1XB2) + 1^ (^2 n S2) Stf 'f'l (IaixbJ 

= /2^(/*U) = /2^(7^^). 

By repeating exactly same argument, one sees immediately that 

St^;W(/^o5) = StJ'W if 00 9), 

for every for i = 2, 3, 4 (the partitions ai being defined as in Point (II) above) so that the 
quantity 

E Sti'^-Hf0o9) 

i=l,...,4 

equals necessarily the expression appearing in ()6.23p . Now we focus on the partition appear- 
ing in Point (III). Plainly (by using once again the notation introduced in (|5.54p ). B2 ((T5) = 
{{1,3} , {2,4}}, IB2 ((75)1 = 2, and the set PB2 (0-5) contains two elements, namely 

({{1,3}};{{2,4}}) and ({{2, 4}} ; {{1, 3}}) 

(note that we write {{1,3}} (with two accolades), since the elements of PB2 (1T5) are pairs of 
collections of blocks of cj2, so that {{1,3}} is indeed the singleton whose only element is {1, 3}). 
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We can now apply formula (|5.58p to deduce that 

St?,'W (/ 00 g) = StJW ((1^^^^^ + lA,y,A,) 00 (1BixB2 + Um)) (6.25) 
= 2 [z. (Ai n Stf 'W {lA.nB,) + y{Alf^ B^) Stf (lA^nsJ 
+u {A2 n Stf W (lAinBj + (^2 n S2) stf 'W (IaiRbJ" 

+St^''^^ (l(AinBi)x(A2nB2) + l(AinB2)x{A2nBi) + l{A2nBi)x(AinB2) + l(A2nB2)x(AinBi)) 

(Ai n -Bi) V {A2 r]B2) + v {Ai n B2) v {A2 n B{) 

+v {A2 n Bi) V {Ax n S2) + (yl2 n B2) v {Ai n B{) . 
One easily verifies that 

V (Ai n Stf W (lA2nB2) + z^ (^1 n S2) Stf 'W (lA2nBi) 
-z. (^2 n Bi) St f ' W (lAinSa) + (^2 n i?2) St (lA.nSi ; 
2/f(/*2 5)=2/f(75^), (6.26) 



and moreover 

l(AinBi)x(A2nB2) + l(AinB2)x(A2nSi) + l(A2nBi)x(AinB2) + l(A2nS2)x(AinSi) 

= 7^9 (6-27) 

and 

(/>9)l2(,2) = v{Axr^Bx)v{A2r\B2)^v{Ax^B2)v[,A2r\Bx) (6.28) 

{A2 n Bi) V {Ax nB2) + iy {A2 n B2) v {Ai n Si) . 

Since, trivially, St^'^^' (/ 00 5) = St^''^' (/ 0o 5)) we deduce immediately from (j6.25p - (j6.28p 

that the sum St^''^^ (/ 0o o) + St^''^' (/ 0o g) equals the expression appearing in (I6.24p . This 
proves the first part of the Proposition. The last assertion in the statement can be proved by a 
density argument, similar to the one used in order to conclude the proof of Proposition 16. 1[ ■ 

Other proofs of Proposition 16.21 can be found for instance in [38 1 112H I126j . 

Examples, (i) When p = q = 1, one obtains 

I? if) I? (9) = i§ {f^g) + If (pfg^ + (/, g)LHu) ■ 

(ii) When p = 2, and q = 1, one has 

i?if)i?{g) = (7^5) + 2/2^ (7^) + 2/f (7^^) 

/ {zi,Z2) g (Z3) N {dzi) N {dz2) N {dz^) 



+2 / / azi.Z2)9{zx)N{dzx)N{dz2) 
+2 [ ( [ f{zx,x)g{zx)u{dx)]N{dzx). 
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7 Diagram formulae 



We now want a general formula for computing cumulants and expectations of products of mul- 
tiple integrals, that is, formulae for objects of the type 

E[ll{h)x...xI^Jfk)] and x K ifi) , I^Jfk)) ■ 



7.1 Formulae for moments and cumulants 

As in the previous sections, we shall focus on completely random measures (/? that are also good 
(in the sense of Definition [3|) , so that moments and cumulants are well-defined. As usual, we 
shall assume that the control measure v is non-atomic. This last assumption is not enough, 
however, because while the measure (A) = Kip (A)'^ may be non-atomic, for some n > 2 the 
mean measure (concentrated on the "full diagonal") 



(A^(A))4E 



may be atomic. We shall therefore assume that ip is "multiplicative", that is, that this phe- 
nomenon does not take place for any n > 2. 

Proceeding formally, let (p he a good random measure on Z, and fix n > 2. Recall that 
denotes the collection of all sets B in Z®" such that i/®" {B) = z^" (B) < oo (see (jO])). As 
before, for every partition vr € 'P ([?t.]), the class Z^ is the collection of all vr-diagonal elements 
of Z"' (see ()5.ip ). Recall also that St^''"^ is the restriction of the measure (^®" = y?'"! on (see 
(lOHD ^. Now let 



St^'i")^ (C) 
Ar (A) 
K {A) 

m (A) 



E 



St^'W (C) 



CeZ!: 



viA), 



St' 



i 



{A X ■ ■ ■ X A), Ae Z^, 



n times 

E[A^{A)], AeZ,. 



(7.1) 
(7.2) 
(7.3) 

(7.4) 



Thus, An (A) denotes the random measure concentrated on the full diagonal zi 
of the ntuple product A x ■ ■ ■ x A, and (•) denotes expectation. 



Definition 8 We say that the good completely random measure ip is multiplicative if the 

deterministic measure A i—>- (An) (A) is non-atomic for every n > 2. We show in the examples 
below that a Gaussian or compensated Poisson measure, with non-atomic control measure v , is 
always multiplicative. 



The term "multiplicative" (which we take from |106j ) originates from the fact that ip is 
multiplicative (in the sense of the previous definition) if and only if for every partition tt the non- 
random measure (st^'["])(-) can be written as a product measure. In particular (see Proposition 
8 in |106j ) , the completely random measure ip is multiplicative if and only if for every vr G ( [?^] ) 
and every ^i, ...,An G Z,^, 

(st^'N) {A,x.--xAn) = ll (Stf H^ll) ^XA,>j , (7.5) 
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where, for every b = {ji, ^ tt, we used once again the notation X Aj = Aj^ x • • • x Aj^,. 

Note that the RHS of (j7.5p involves products over blocks of the partition vr, in which there is 
concentration over the diagonals associated with the blocks. Thus, in view of (15. 2[) and (17. 3p . 
one has that 

(st^'M^ (Ai X • • . X A„) = n (aJi) (n.etAj) , (7.6) 

ben 

that is, we can express the LHS of ()7.5p as a product of measures involving sets in Z^. Observe 
that one can rewrite relation (j7.5p in the following (compact) way: 

(st^.W^ = (g)^Stf[Hiy (7.7) 



Examples, (i) When ip is Gaussian with non-atomic control measure i^, relation 
implies that ^St^'^"^^ is if vr contains at least one block b such that |6| ^ 2. If, on the ott 
hand, every block of vr contains exactly two elements, we deduce from (j5.5ip and ()5.53p that 



St^'W)(Ai x-.-x A„)= H uiADAj), (7.8) 

b={i,j}eTT 



which is not atomic. 

(ii) If (/? is a compensated Poisson measure with non-atomic control measure z^, then ^St^''*^' 
is whenever tt contains at least one block b such that \b\ = 1 (indeed, that block would have 
measure 0, since ip is centered). If, on the other hand, every block of vr has more than two 
elements, then, by Corollarv 15.11 



Stt>^) {A, x.-.x An) = 11 n ^{Aj,n---nA,J, (7.9) 

fc=2fe={jivjfc}67r 

which is non-atomic. See |106j for (quite pathological) examples of non-multiplicative measures. 
Notation. In what follows, the notation 

/ / (zi, z„) (g) (Stf ll'll) (dzi, (iz„) ^ (g) (Stf'll^ll) (/) (7.10) 

b€TT ben 

will be used for every function / G (i^") . 

The next result gives a new universal combinatorial formula for the computation of the 
cumulants and the moments associated with the multiple Wiener- Ito integrals with respect to a 
completely random multiplicative measure. 



■^The integral f{d (g) (st?'"''")} in (TTTOll is well defined, since the set function (g) (st?'"''") (■) is a cr- 

additive signed measure (thanks to ((S^SJ) on the algebra generated by the products of the type y4i x ■ ■ ■ x An, 
where each Aj is in Z,^. 
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Theorem 7.1 (Diagram formulae) Let ip be a good completely random measure, with non- 
atomic control measure v, and suppose that is also multiplicative in the sense of Definition 
For every ni,...,nk > 1, we write n = ni + ■ ■ ■ + n^, and we denote by n* the partition 
of N = {l)---)'^} given by /16.1\) . Then, for every collection of kernels fi,...,fk such that 
fj £ £s,o (i^^^), one has that 

E [II (/i) ..-II ifk)] = E (Stf f"") (/i 00 /2 00 • • • 00 fk) , (7.11) 

{(7eP([n]):aATT*=d} ^6°" 



and 



x{ii{fi),---j^jfk))= (2)(stf^""^)(/i0o/2 



fk) , (7.12) 



o-A7r*=0 beo- 
(TV7r* = i 



Proof. Formula (j7.1ip is a consequence of Theorem 16.11 and (j7.5p . In order to prove (|7.12p , 
we shall first show that the following two equalities hold 



x{ll{fi)r-;I^Afk)) 

I 

TT*<p={ri,...,ri)£V{[n]) j=l 

E /^(/^'i) E 



n (f^) 

a:{niA |-na_i+l,...,niH hna}Crj 



St 



(/l 00 • • • 00 fk) , 



(7.13) 
(7.14) 



7r*<p=(ri,...,r;)GP([n]) 



7<p be7 
7A7r*=6 



where ni + no = by convention. 

The proof of (j7.13p uses arguments analogous to those in the proof of Malyshev's formula 
(j4.17p . Indeed, one can use relation (j3.5p to deduce that 

x{ii{fi),--;i^jfk))= E i-iy-' {I - iv-Yl^ U^nAf-) ■ (7-15) 

a={xi,...,xi}eV{[k]) j=l [a(^Xj 

Now observe that there exists a bijection 

V{[k])^[7T*,i] :a^p^^\ 

between 'P([A:]) and the segment [vr*,!], which is defined as the set of those p S 'P(M) such 
that TT* < p, where tt* is given by ()6.ip . Such a bijection is realized as follows: for every 
a = {xi, - .-jXi} € V {[k]), define p^'^^ € [tt*, l] by merging two blocks 



{ni 



Ua-i + 1, ni + • • • + Ua} and {ni + • • • + nt-i + 1, ni + • • • + m} 



of TT* (1 < a 7^ 6 < A;) if and only if a ^^a- b. Note that this construction implies that \a\ 
= so that i^Mj yields 



-iy-'ii-i)\ = p{a,i)=p(p('^\i 



(7.16) 
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(observe that the two Mobius functions appearing in (j7.16p refer to two different lattices of 
partitions). Now use the notation p^'^^ = ^r^\ ...,r^^'^^| to indicate the blocks of p^'^^: since, by 
construction, 



(7.17) 



riE 


n if a) 






n Ua 








a:{ni+- 


■+na_i+l,.--,"iH hriajCrj''-' 



we immediately obtain (j7.13p by plugging (j7.16p and (j7.17p into (j7.15p . 

To prove (I7.14p . fix p = {ri, n} such that vr* < p. For j = 1, /, we write vr* (j) to indicate 
the partition of the block Vj whose blocks are the sets {ni + • • • + Ua-i + 1, ni + • • • + Ua} 
such that 

{ni H h na-i + 1, ...,ni + • • ■ + Ua] Q rj. (7.18) 

According to (|7.1ip . 



E 



n 

a:{niA |-na-i+l,...,niH hnajCrj 



E (2)(str"^")({^.,,o/}) 



where the function {(SirjAf} is obtained by juxtaposing the \tt* functions fa such that the 
index a verifies ()7.18p . Now observe that 7 G ( [^t-] ) satisfies 

7 < p and 7 A vr* = O, 

if and only if 7 admits a (unique) representation as a union of the type 



where each a (j) is an element of V {vj) such that a (j) A vr* (j) = 0. This yields 



n E (2)(str"^'^)({^^.o/}) 

E (g)(stfii^ii)(A®o---^oA). 



7<p 667 
7A7r*=0 



This relation, together with ([7T6]) and dZUD, shows that (f7T3]) implies (HHD. To conclude the 
proof, just observe that, by inverting the order of summation in (|7.14p . one obtains that 



x{l^Ah)r-;I^Mk)) = (2)(Str"'"')(/i®o---C5o/fc) ^ /i (p, i) 

7A7r*=0 ^'^7 7r*V7<p<i 

E (g)(stf[l''ll)(/i®o---^o/fc), 



7A7r*=0 

TT* V7=l 
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where the last equahty is a consequence of the relation 

^ f n - / 1 if ^* V 7 = i 
2^ f{P^^) ^0 otherwise, 

TT* V7<p<l 

which is in turn a special case of (j2.14p . ■ 

Remark. Observe that the only difference between the moment formula (jT.lip and the 
cumulant formula ()7.12p is that in the first case the sum is over all a such that a A n* = = 
{{1} , {?^}}, and that in the second case a must satisfy in addition that cr V vr* = 1 = 
Moreover, the relations ()7.1ip and (j7.12p can be restated in terms of diagrams by rewriting the 
sums as 

E = E ; E = E 

{cre'P{[n]):aAn*=6} (T6-p([n]):r(7r*,CT) is non-flat aATT*=g CTe'P([n]):r{7r*,o-) is non-fiat 

CTV7r*=i and connected 

where F {TT*,a) is the diagram of {Tr*,a), as defined in Section [4.11 
7.2 The Gaussian case 

We shall now provide a version of Theorem 17.11 in the case where ip is, respectively, Gaussian 
and Poisson. For convenience, using the same notation as that in Theorem I7.H let 

M{[n],TT*) = {aeV{[n]):(T\/TT* = iandaATT* = 6} (7.19) 

7W°([n],7r*) = {a e V {[n]) : a A TT* = 0} (7.20) 

and 

7W2(N,7r*) ^ {a G A^([n],^*) : 161 = 2, V6g a} (7.21) 

X0([n],7r*) ^ {aeM^{[n],TT*):\b\ = 2, ybea} (7.22) 

M>2i[n],TT*) ^ {a eMi[n],TT*) ■.\b\>2, ybea} (7.23) 

A^02([n],7r*) ^ {aGM°{[n],TT*):\b\>2, ybea} (7.24) 

where the partition vr* G V {[n]) is defined in (|6.ip . The sets M2{[n],7r*) and >l^([n],7r*) 
appear in the case where ip is Gaussian. Note that, by using the formalism of diagrams F and 
multigraphs F introduced in Section [H one has that 



M{[n],-jr*) = {aeV{[n] 

M°{[n],7r*) = {aeV{[n] 

M2{[n],Tr*) = {aeV{[n] 

= |crGP([n 

Ml{[n],7r*) = {aeV{[n] 

= |o-GP([n 

Clearly, M2i[n],Tr*) C ([n] , vr*), M2{[n],Tr*) C M>2 {[n] , n*) and 

A^0([n],7r*)c^°2([n],7r*). 



r('K*,a) is non-flat and connected} (7.25) 

F(7r*, cr) is connected} (7.26) 

F(7r*, cr) is Gaussian, non-flat and connected} (7.27) 

f (vr*, cr) has no loops and is connectedj 

F(7r*, cr) is Gaussian and non- flat} (7.28) 

f (vr*, fj) has no loopsj . 
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The sets M>2 (N ,7r*) and ([n] ,7r*) appear when 99 is a compensated Poisson measure, 

namely ip = N. 



Corollary 7.1 (Gaussian measures) Suppose ip = G is a centered Gaussian measure with 
non-atomic control measure v, fix integers rii, ...,71^ > 1 and let n = ui + ■ ■ ■ + Uk- Write vr* for 
the partition of [n] appearing in \6.1\) . Then, for any vector of functions {fi,---,fk) such that 
fj E (z^"^ ), j = 1, k, the following relations hold: 

1. If M.2 (W ,71"*) = (in particular, if n is odd), then x {ini (/i) > ' ' '^-^n^ ifk)) = 0/ 

2. If M2 (N ,7r*) / 0, then 

x(4(/i),---,4^,(/fc))= E / Ud^^"^ (7-29) 

/ 7n/2 

where, for every a G ([n] , vr*), t/ie function /o-,fc, of n/2 variables, is obtained by 
identifying the variables Xi and Xj in the argument of fi ®q ■ ■ ■ (giQ fn,, (o.s given in /i6. ^) ) 
if and only if i ~o- j; 

3. If Ml (N ,7r*) = (in particular, if n is odd), then E (/^^ (/i) ■ ■ ■ I^^ {fk)) = 0; 

4. IfMl{[n],'K*)^0, 



^{ll{fi)---lZ{fk))= E / Z'^.'^^^"^' 

aeA40([n],7r*) 



(7.30) 



Proof. First observe that, since 99 = G is Gaussian, then ^St?'"^'^^ = whenever \b\ 7^ 2. 

Assume for the moment that fj E <5s^o (z^"^)) j = 1,...,A:. In this case, we can apply formula 
(|7.12p and obtain that 

x{i?.Ah),---J^Mk)) 

E (2)(St5''""^)(/l®o/2®0---®o/fc) 
{(r:o-A7r*=6 ; ''Go" 
crV7r*=i ; \b\=2 Vbecr} 

E (8)(Stf'f"")(/l®o/2 0O---®oA), 

where we have used (|7.2ip . The last relation trivially implies Point 1 in the statement. Moreover, 
since, for every B,C € Z^, 



St ^'^'^ ^{BxC) = (St ^'^'^ ^ ((B n C7) X (B n C7)) = ( ) (5 n C) , (7.31) 

one deduces immediately that the support of the deterministic measure /st?'"^'^\ is con- 
tained in the set 

^>u = {(^i! ^n) ■ Zi = Zj for every i,j such that i j} . 
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Since, by ([53T]) and (|73T]) . 



Stf'tl''ll\(5xC7) = zy(SnC), (7.32) 



for every B,C G Z^, we infer that 

Jstf '[I'll) (/i 00 /2 00 • • • ®o A) = (g) (Stf [I'll) (/.) = ^^^^ (7.33) 



beer bee 



where the function f^i^ is defined in the statement. To obtain the last equahty in (j7.33p . 
one should start with functions of type (zi, ) = l„o) „(j) (zi, ), where the 

C^'^^ € -Zi/ are disjoint, and then apply formula (17.81) . so that the extension to general functions 
fj € £s,o (z^"^) is obtained by the multilinearity of the application 



ifl, ■■; fk) / fcT,k 



To obtain (j7.29p for general functions fi, fk such that fj e (i^^^), start by observing that 
£s,o{i^"'^) is dense in L^(z^"j), and then use the fact that, if a sequence f'^\ r > 1, is 

such that ff^ G ^,,0 (z^"0 and ff^ fj in ^ ^j^^^^ 

X (4^, {fi'^) (/f ) ) - X {Ig ifl) {fk)) , 

by (j5.46p . and moreover 

where f^l is constructed from f^'\ f^\ as specified in the statement (a similar argument 
was needed in the proof of Proposition 16. ip . Points 3 and 4 in the statement are obtained 
analogously, by using the relations 

E(/^J/i),...,/^J/fc)) 



0(stftl'll)(/i 00/200 ■■•C3oA) 



\b\=2 VbGcr} 

E (2)(st5''""^)(/i®o/2 0o---0o/fc), 

cTeM%([n],TT*) bea 

and then by applying the same line of reasoning as above. ■ 

Examples, (i) We want to use Corollary 17.11 to compute the cumulant of the two integrals 

Igifl) = [ fl{zi,...,Zn,)G{dzi)---G{dZn,) 

Jz;^ 

InAh) = I f2izi,...,Zn,)G{dzi)---G{dZn,), 
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that is, the quantity 

X (/l) , (/2)) = E (/l) Ig (/2)) . 

Here, vr* G P ([ni + 77-2]) is given by ir* = {{1, ni} , {ni + 1, ni + n2}}. It is easily seen 
that M.2 {[ni + 71-2] , vr*) / if and only if ni = n2. Indeed, each partition M.2 {[ni + 722] , vr*) is 
of the form 

o- = {{n,«2} : k G {1, ,Z2 G {m + 1, ...,ni +722}} (7.34) 

(this is the case because a must have blocks of size |6| = 2 only, and no blocks can be constructed 
using only the indices {1, .■■,ni} or {ni + 1, ...,ni + 722}, since the corresponding diagram must 
be non-flat). In the case where ni = n2, there are exactly nil partitions as in (I7.34p . since to 
each element in {1, ...,rei} one attaches one element of {ni + 1, 7^1 + 722}. Moreover, for any 
such a one has that 

/ /<x,2d^^"/'= / /i/2di^"S (7.35) 
where n = ni + n2 and we have used the symmetry of /i and /2 to obtain that 

/<7,2 (^Zi,...,Zll^ = fa,2 izi,...,Zni) = fl{zi,...,Zni) f2izi,...,Zn^) . 

From (I7.30p and ()7.35p . we deduce that 

E {Ig ifl) Ig U2)) = ln,=n, X m! / /l/2di."S 

as expected (see (j5.42p ). Note also that, since every diagram associated with vr* has two rows, 
one also has 

M2 ([ni + 722] , TT*) = Ml {[m + 722] , n*) , 
that is, every non-flat diagram is also connected, thus yielding (thanks to (|7.29p and (j7.30p ) 

X {Ig (/i) , Ig (h)) = E {Ig (/i) Ig (/2)) . 

(ii) We fix an integer A: > 3 and set rii = ... = tz^ = 1, that is, we focus on functions 
fj, j = l,...,k, of one variable, so that the integral if {fj) is Gaussian for every j, and we 

consider x {l? ifi) , I? ifk)) and E [/f (/i) , if (fk)] . In this case, ni H \-nk = k, and 

vr* = {{1} , {k}} = 0. For instance, for k = 6, tt* is represented in Fig. 19. 



Figure 19: A representation of the partition 



73 



In that case M2 {W\ 1 — ^1 because all diagrams will be disconnected. One of such diagrams 
is represented in Fig. 20. 




Figure 20: A disconnected Gaussian diagram 



(Exercise: give an algebraic proof of the fact that M.2 jVr*) = 0). It follows from Point 1 
of Corollary O that 

X(lf(/i),...,lf (/fc))=0 

(this is consistent with the properties of cumulants of Gaussian vectors noted in Section [3]). Now 
focus on M2 {[k] , vr*). If k is odd the class M2 {[k] , tt*) is empty, and, for k even, M2 {[k] , vr*) 
coincides with the collection of all partitions 

a = GT'([A:]) (7.36) 

whose blocks have size two (that is, M.2 {[k] ; '^*) is the class of all perfect matchings of the first 
k integers). For cr as in (|7.36p . we have 



{«i,ii}eo- 

Z=l,...,fc/2 

Points 3 and 4 of Corollary 17.11 yield therefore 
E (/f (/i) ... If (A)) 

I 0, k odd. ' 

which is just a special case of (j3.16p . since E (if (/j) if (/j)) = fi-^fj^dv. For instance, if 
k = A, one has that 

E (/f (/i) • • • /f (/4)) = I hf2dy X / hUdv + / hhdv X / f2hdiy 

J Z J Z J Z J z 

fifidu X / f2hdv. 



(iii) Consider the case A: = 3, ni = 2, n2 = na = 1. Here, n = ni + n2 + = 4, and 
vr* = {{1, 2} , {3} , {4}}. The partition vr* is represented in Fig. 21. 
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Figure 21: A three-block partition 

The class Ai2 ([4] ,vr*) contains only two elements, namely 

ai = {{l,3},{2,4}} and cis = {{1, 4} , {2, 3}} , 
whose diagrams are given in Fig. 22. 




Figm-e 22: The two elements of 7W2([4], tt*) 



Since the rows of these diagrams cannot be divided into two subsets (see Section HTT]) . they are 
connected, and one has M.2 ([4] , tt*) = M2 ([4] , vr*), that is, cumulants equal moments by (|7.29p 
and (j7.30p . Moreover, 



/ai,3 izi,Z2) 
fa2,3 {Z1,Z2) 



It follows that 

rG (' £ \ jG f £ \ jG 



x{ik{h)jnf2)jnh)) 



fl{zi,Z2) f2{zi) h{z2) 
fl{zi,Z2) f2{z2) h{zi) . 



^{Ik{h)l?{f2)l?{h)) 

{fai,3 {Z1,Z2) + /<72,3 {zi,Z2)}iy'^ {dzi,dZ2) 

= 2/ h{zi,Z2) f2{zi) h{z2)u'^ {dzi,dz2) , 

where in the last equality we have used the symmetry of /i. 

(iv) We want to use Point 1 and 2 of Corollary 17.11 to compute the fcth cumulant 

k times. 



for every A; > 3. This can be done by specializing formula (17.291) to the case: /c > 3 and 
ni = n2 = ... = rifc = 2. Here, n = 2k and vr* = {{1, 2} , {3, 4} , {2k — 1, 2A;}}; for instance, 
for fc = 4 the partition vr* can be represented as in Fig. 23. 
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Figure 23: A four-block partition 



One element of the set A42 ([2A;] , vr*) is given by the partition 

a* = {{1, 2k} , {2, 3} , {4, 5} , {2k - 2, 2k}} G V {[2k]) 
whose diagram (for /c = 4) appears in Fig. 24. 



Figure 24: A circular diagram with four rows 

Note that such a diagram is circular, and that the corresponding multigraph looks like the one 
in Fig. 16. Therefore, 

/a*,fe {Zl, Zk) = f izi,Z2) f {Z2, Z^) ■ ■ ■ f Zfc) / (Zfc, Zl) . (7.37) 

It is not difficult to see that AI2 ([2^] , vr*) contains exactly 2^~^ ~ 1)! elements and that the 
diagram r(7r*,cj) associated to each a € A^2 ,7r*) is equivalent (up to a permutation, or 
equivalently to a renumbering, of the rows) to a circular diagram (see Section [4.ip . It follows 
that, for every a G M2 ([2A;] ,vr*), one has that 

/cr,fc {Zl, Zk) = /cr*,fc {Zl, Zk) , 

where /o-*,2A; is given in (j7.37p . This yields the classic formula (see e.g. [22] ) 

Xk{lHf)) (7.38) 
= 2^'^ {k-l)\ f {zi,Z2) f iz2, Z3) ■ ■ ■ f {zk-i, Zk) f (zk, Zl) V (dzi) ■ ■ - u (dzk) ■ 

For a non-combinatorial proof of (j7.38p see e.g. 167\ Section 2.2]. 
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7.3 The Poisson case 

The following result provides diagram formulae for Wiener-Ito integrals with respect to com- 
pensated Poisson measures. It is stated only for elementary functions, so as not to have to deal 
with convergence issues. The proof is similar to the one of Corollary [TTl and it is only sketched. 
We let M>2 {[n] ,tt*) and A45,2 ([n] ,tt*) be defined as in Section [7^21 

Corollary 7.2 (Poisson measures) Suppose (p = N is a centered Poisson measure with non- 
atomic control measure u, fix integers ni, ...,nfc > 1 and let n = ni -\- ■ ■ ■ + n^. Write tt* for 
the partition of [n] appearing in 116. Then, for any vector of functions {fi,...,fk) such that 
fj G £s,o i^"'^), j = I, ■■■,k, the following relations hold: 

1. IfM>2 (M ,vr*) = 0, then x (4 (/i) ' " " ^4 (Z^)) = 0' 

2. If M>2{[n],'K*) ^ 0, then 

x(4(/i),---,4(/fc)) = E / (7-39) 

where, for every a G Al>2 ([?t-] , vr*), the function in \a\ variables, is obtained by 

identifying the variables Xi and xj in the argument of fi0o - ■ ■ fn^ (as defined in i6.3\) ) 
if and only if i ~o- j; 

3. IfM% (M ,7r*) = 0, then E (/i) ■ ■ ■ (f^)) = 0; 

4. IfM%{[n],7T*)^0, 

e(4(/i),...,4(/,)) = Yl [ f'^^>^du\-^- (7-40) 

Sketch of the Proof. The proof follows closely that of Corollary 17.11 The only difference 
is in evaluating (j7.6|) . Instead of having (j7.8|) which requires considering M.2 and A^^, one has 
(j7.9p . which implies that one must use M.>2 and A4%2- ■ 

Remark. Corollaries 17.11 and 17.21 are quite similar. In the Poisson case, however, fu^k 
depends on |o"| variables, whereas in the Gaussian case it depends on n/2 variables. 

Examples. All kernels appearing in the following examples are symmetric, elementary and 
vanishing on diagonals (this ensures that multiple integrals have moments of all orders), 
(i) We apply Corollarv 17.21 in order to compute the cumulant 

X (4 (/l) , 4 (/2)) = E (4 (/l) li (/2)) , 

where ni,n2 > 1 are arbitrary. In this case, tt* V {[ni + 71,2]) is given by 

TT* = {{1, ...,ni} , {ni + 1, ...,ni + 722}} . 
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Moreover, 

A^^([ni + n2],7r*) = ([m + na] , vr*) 

= M>2 {[ni + ns] , vr*) = M%2 {[^1 + ^^2] , ^*) 

(indeed, since any diagram of vr* is composed of two rows, every non-flat diagram must be 
necessarily connected and Gaussian). This gives, in particular, A4>2 (['^i + n-2] ,7r*) 7^ if and 
only if rii =722. The computations performed in the Gaussian case thus apply and therefore 
yield 

X (4 (/l) , 4 (/2)) = IE (4 (/l) 4 (/2)) = ln,=n, X n,\ J^^^ hf2dv''\ 

which is once again consistent with (15.42p . 

(ii) Consider the case /c = 3, ni = n2 = 2, ns = 1. Here, n = ni + n2 + = 5, and 
IT* = {{1, 2} , {3, 4} , {5}}. The partition vr* can be represented as in Fig. 25. 



Figure 25: A three-row partition 



The class M.%2 ([^] j^*)) of '^'s such that o" A vr* = 0, contains four elements, that is, 

cTi = {{1,3,5}, {2,4}}, (72 = {{1,4}, {2, 3, 5}} 

as = {{1,3}, {2, 4, 5}} and (14 = {{1, 4, 5} , {2, 3}} , 

whose diagrams are given in Fig. 26. 




Since all these diagrams are connected, the class M.>2 ([5] ,vr*) coincides with M%2 ([^] )■""*)• 
Note also that, since the above diagrams have an odd number of vertices, A1>2 ([5] ,7r*) does 
not contain partitions a whose diagram is Gaussian. Thus, 

fai,3{zi,Z2) = fl{zi,Z2) f2{zi,Z2) h{zi) 

fa2,3{zi,Z2) = fl{zi,Z2) f2{z2,Zl) h{z2) 

fa3:i{zi,Z2) = fl{zi,Z2) f2{zi,Z2) h{z2) 

fa4,3{zi,Z2) = fl{zi,Z2) f2iz2,Zi) hizi) . 
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For instance, /o-i,3 (-^i, Z2) has been obtained by identifying the variables of /i (xi, X2) /2 {x3,X4) (x^) 
as xi = xs = = z\ and X2 = X4 = 2:2. By exploiting the symmetry of f\ and /2, one deduces 
that the four quantities 



Z2 



/<7,,3 (^1,^2) {dzi,dz2) , i = l, ...,4, 



are equal. It follows from ()7.39p and (j7.40p that 

X(4ifl)ji'if2),l{'if3)) = ^(4ifl)4if2)l{'if3) 



= {fl{zi,Z2) f2{zi,Z2) f3{zi)}u'^ {dzi,dZ2) . 

(iii) Consider the case k = 4 and = 1, z = 1, 4. Here, vr* = = {{1} , {2} , {3} , {4}}, and 
consequently vr* can be represented as a single column of four vertices. The class 7W>2 ([4] ,7r*) 
contains only the maximal partition 1 = {{1, 2, 3, 4}}, whereas A^>2 ([5] , vr*) contains 1 and the 
three elements 

ai = {{l,2},{3,4}},a2 = {{l,3},{2,4}}, and 
as = {{1,4}, {2, 3}}. 

The diagrams associated with the class A1>2 ([^] )^*) — {l; <^i) <^2, C3} are represented in Fig. 
27. 



I 



Figure 27: The elements of A45,2([5], vr*) 



Now take fi = f for i = 1, 4, where / is an elementary kernel. One has that 

fu.Ai^i^Z'i) = / (^1)^/(2^2)^, j = l,2,3. 



It follows from ([739]) and ([7^ that 

x(/f (/) 
E (/f iff 



X4 ( /f (/) ] = jj {zf V (dz) 



fizfHdz) 



+3 / f{ziff{z2fu\dzi,dz2). 

'Z2 



(iv) Let y be a centered random variable with finite moments of all orders, and suppose that 
Y is infinitely divisible and such that 



E [exp {iXY)] = exp 



(7.41) 
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where the measure p is such that p({0}) = and J^\u\^p{du) < oo for every k > 1. Then, 
combining (|7.41l) and (j3.2p . one deduces that 



Xk{Y) = / u'^pidu), k>2, (7.42) 

JR 

(note that xi (Y) = E{Y) =0). We shall prove that (17^ is consistent with ([739]). Indeed, 
according to the discussion contained in Section 15.21 one has that 

y''^ [ [\N{du,dx) = lt{f), 

jR Jo 

where f{u,x) = "ulp,!] (x), and iV is a centered Poisson measure on [0,1] x M, with control 
p (du) dx. It follows that 

Xk (Y) = Xkil? (/)) = Xil? if) , (/))• (7.43) 

^ V ' 

k times 

The RHS of (j7.43p can be computed by means of Corollary 17.21 in the special case where nj = 1 
(Vj = 1, k), n = TijUj = k, and vr* = = {{1} , {k}}. One has clearly that 1 is the only 
partition such that the diagram F (O, l) is connected, so that 

>^>2([A:],^*) = {i}={{l,...,A;}}. 

Since 

we can now use (I7.39|) to deduce that 

Xk{lhf))= I [' fik{u,x)p{du)dx= C dx [ u''p{du)= [ u'^pidu). 



(v) As an explicit example of (j7.42p , consider the case where y is a centered Gamma random 
variable with shape parameter a > and unitary scale parameter, that is. 



a e — 1 — lAU e — 



E [exp (iXY)] = —E = exp 

[l-iX) I Jo ^ J u 

Thus, p{du) = al|„>o}'"~^'2~"(iu. It follows that, xi ^) = E {¥) = and, for k>2, 

r /I 

{Y) = a n'^e-"— = aV (k) =a{k-l)\. 
Jm u 

8 From Gaussian measures to isonormal Gaussian processes 

For the sake of completeness, in this section we show how to generalize part of the previous 
results to the case of an isonormal Gaussian process. These objects have been introduced by 
R.M. Dudley in [TT], and are a natural generalization of the Gaussian measures introduced in 
Section 15.11 In particular, the concept of isonormal Gaussian process can be very useful in 
the study of fractional fields. See e.g. Pipiras and Taqqu [Ml ESJ [96], or the second edition 
of Nualart's book [75]. For a general approach to Gaussian analysis by means of Hilbert space 
techniques, and for further details on the subjects discussed in this section, the reader is referred 
to Janson 
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8.1 General definitions and examples 

Let Sjhe a real separable Hilbert space with inner product (•, •)^. In what follows, we will denote 
by 

X = X{Sj) = {X{h):heSj} 

an isonormal Gaussian process over f). This means that X is a centered real- valued Gaussian 
family, indexed by the elements of and such that 

E[X {h)X {h')] = {h,h')^, yh,h'es). (8.1) 

In other words, relation ()8.ip means that X is a centered Gaussian Hilbert space (with respect 
to the inner product canonically induced by the covariance) isomorphic to Sj. 

Example (Euclidean spaces). Fix an integer d > 1, set ^ = M*^ and let (ei,...,erf) be an 
orthonormal basis of U.'^ (with respect to the usual Euclidean inner product). Let (Zi, Z^) be 
a Gaussian vector whose components are i.i.d. N (0, 1). For every h = Yl'j=i '^j^j (where the Cj 
are real and uniquely defined), set X (h) = Yl'j=i ^j^j ^^'^ define X = {X (/i) : h € M'^}. Then, 
X is an isonormal Gaussian process over M'^. 

Example (Gaussian measures). Let (Z, ^,i/) be a measure space, where i' is positive, a- 
finite and non atomic. Consider a completely random Gaussian measure G = {G (A) : A G Z^y} 
(as defined in Section [5T]) . where the class Z^, is given by (j5.3p . Set ^ = (Z, Z,i/) (thus, 
for every h,h' G Sj, {h,h')sj = f^h{z)h'{z)i>{dz)) and, for every h & Sj, define X (h) = if {h) 
to be the Wiener-Ito integral of h with respect to G, as defined in ()5.14p . Recall that X (h) 
is a centered Gaussian random variable with variance given by Then, relation (lETHI) 

implies that the collection X = |X (h) : h ^ L"^ {Z, Z, i/)} is an isonormal Gaussian process over 
L^{Z,Z,u). 

Example {Isonormal spaces built from covariances) . Let Y = {Yt : t > 0} be a real- valued 
centered Gaussian process indexed by the positive axis, and set R {s, t) = K [YsYt] to be the 
covariance function of Y. Then, one can embed Y into some isonormal Gaussian process as 
follows: (i) define £ as the collection of all finite linear combinations of indicator functions of 
the type l[o,t]i t > 0; (ii) define S) = S)ji to be the Hilbert space given by the closure of £ with 
respect to the inner product 

id 

where / = Yli'^i'^[o,Si] and h = J2j '^j'^[o,tj] two generic elements of £; (iii) for h = 
Y.j Cj'i-[o,t,] G £, set X{h) = Y.jCjYtr, (iv) for h G S)r, set X (h) to be the (P) limit of 
any sequence of the type X (hn), where {/in} C £ converges to h in Sjr. Note that such a 
sequence {hn} necessarily exists and may not be unique (however, the definition of X (h) does 
not depend on the choice of the sequence {hn}). Then, by construction, the Gaussian space 
{X (h) : h G Sj} is an isonormal Gaussian process over Sjr. See Janson [36], Ch. 1] or Nualart 
|75j for more details on this construction. 

Example (Even functions and symmetric measures). Other classic examples of isonor- 
mal Gaussian processes (see e.g., [HI [Ml HHl I122j ) are given by objects of the type X/^ = 
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{X^ (^) : ijj € S^E,f3}: where /3 is a real non-atomic symmetric measure on (— vr, vr] (that is, 
P (dx) = (3 {—dx)), and 

SjE,i3 = Ll{{-7r,7r],dp) (8.2) 

stands for the collection of real linear combinations of complex-valued even functions that are 
square-integrable with respect to P (recall that a function ip is even if ip (x) = ip{—x)). The 
class S^E,i3 is indeed a real Hilbert space, endowed with the inner product 

/TT 
^Pi{x)^2{-x)P{dx) em. (8.3) 
-TT 

This type of construction is used in the spectral theory of time series. 
8.2 Hermite polynomials and Wiener chaos 

We shall now show how to extend the notion of Wiener chaos (as defined in Section 15. 6p to 
the case of an isonormal Gaussian process. The reader is referred to [75] Ch. 1] for a complete 
discussion of this subject. We need some further (standard) definitions. 

Definition 9 The sequence of Hermite polynomials {Hq : q >0} on R, is defined via the 
following relations: Hq = 1 and, for q > 1, 

H„(x) = (-1)'^ e^—e-^ , xeR. 
^ ^ ^ dxi 

For instance, Hi (x) = 1, H2 (x) = x'^ — 1 and H3 (x) = — 3x. 

Recall that the sequence {{ql)~ Hg : (7 > 0} is an orthonormal basis of L (M, (27r)~ ' 
e~^^/^(ix). 

Definition 10 From now on, the symbol Acxn will denote the class of those sequences a = 
{cti : ^ > 1} such that: (i) each Ui is a nonnegative integer, (ii) ai is different from zero only for 
a finite number of indices i. A sequence of this type is called a multiindex. For a G Aoo, we 
use the notation |a| = X^jOj. For q >1, we also write 

Aao,q = {ae Aoo- \a\ = q} ■ 

Remark on notation. Fix q > 2. Given a real separable Hilbert space f), we denote by 
f)'^'^ and respectively, the q'th tensor power of ^ and the qth. symmetric tensor power of 
(see e.g. ^6]). We conventionally set S)'^^ = S)®^ = S^. 

We recall four classic facts concerning tensors powers of Hilbert spaces (see e.g. [36j). 
(I) The spaces and Sj®'^ are real separable Hilbert spaces, such that ij®"^ C S^^'^. 
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(II) Let {cj : j > 1} be an orthonormal basis of Sj; then, an orthonormal basis of Sj^'^ is given 
by the cohection of all tensors of the type 

(g) • • • , ji,...,jd>l. 

(III) Let {cj : j > 1} be an orthonormal basis of f) and endow i^®'' with the inner product 
(■>')sD®9i then, an orthogonal (and, in general, not orthonormal) basis of i^®'^ is given by 
all elements of the type 

e{ji,-,jq) = sym{ej^(g) ■ ■ ■ (g) Cj^} , 1 < Ji < ... < < oo, (8.4) 

where sym{-} stands for a canonical symmetrization. Exercise: find an orthonormal 
basis of ^®''. 

(IV) If ^ = {ZjZ,^), where v is a-finite and non-atomic, then ^®"^ can be identified with 
L2 {Z1, Z1, u1) and fi®'? can be identified with {Z^, Z^, lyi), where (Z^, Z'^, lyi) is the 
subspace of (Z'^ , Z*^ , i''^) composed of symmetric functions. 

Now observe that, once an orthonormal basis of Sj is fixed and due to the symmetrization, 
each element e {ji, jg) in ()8.4p can be completely described in terms of a unique multiindex 
a G Aoo^q, as follows: (i) set = if i 7^ jr for every r = l,...,q, (ii) set aj = k for every 
j S {jl, ■■■,jq} such that j is repeated exactly k times in the vector (ji, jg) {k > 1). 

Examples, (i) The multiindex (1,0,0, ....) is associated with the element of given by ei. 

(ii) Consider the element e (1, 7, 7). In (1, 7, 7) the number 1 is not repeated and 7 is repeated 
twice, hence e (1, 7, 7) is associated with the multiindex a G ^00,3 such that ai = 1, aj = 2 and 
aj = for every j / 1,7, that is, a = (1,0,0,0,0,0,2,0,0, ...). 

(iii) The multindex a = (1,2,2,0,5,0,0,0, ...) is associated with the element of ^®^'^ given 
bye (1,2, 2, 3, 3, 5, 5, 5, 5, 5). 

In what follows, given a £ Aoo,q (? > !)> we shall write e (a) in order to indicate the element 
of S)®"^ uniquely associated with a. 

Definition 11 For every h (z S^, we set if (h) = X{h). Now fix an orthonormal basis 
{cj : j > 1} of S): for every q >2 and every h € ^®'' such that 

h= ^ Co-e (a) 

(with convergence in f)®"^ , endowed with the inner product (•,-)^®,j, we set 

where the products only involve the non-zero terms of each multiindex a, and Hm indicates the 
mth Hermite polynomial . For q > 1, the collection of all random variables of the type (h), 
h G f)®'' , is called the qth Wiener chaos associated with X and is denoted by Cg (X). One 
sets conventionally Cq {X) = M. 
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Examples, (i) li h = e (a), where a = (1, 1,0, 0, 0, ...) € Aoo^2i then 
{h) = Hi {X (ei)) Hi {X (62)) = X (ei) X (ea) . 

(ii) If a = (1, 0, 1, 2, 0, ...) G ^oo,4, then 

/f(/i) = i/i(X(ei))i/i(X(e3))i?2(^(e4)) 
= X(ei)X(e3) (X(e4)'-l) 

= X(ei)X(e3)X(e4)'-X(ei)X(e3). 

(iii) If a = (3, 1, 1, 0, 0, ...) G ^00,5, then 

I^(h) = Hs{X{ei))Hi{X{e2))Hi{X{es)) 
= (x(ei)3-3X(ei))x(e2)X(e3) 
= X {eif X (es) X (63) - 3X (ei) X (ea) X (63) . 

The following result collects some well-known facts concerning Wiener chaos and isonormal 
Gaussian processes. In particular: the first point characterizes the operators as isomorphisms; 
the second point is an equivalent of the chaotic representation property for Gaussian measures, as 
stated in formula (j5.45p : the third point establishes a formal relation between random variables 
of the type (h) and the multiple Wiener-Ito integrals introduced in Section [53] (see |75l Ch. 
1] for proofs and further discussions of all these facts). 

Proposition 8.1 1. For every q > 1, the qth Wiener chaos Cq {X) is a Hilhert subspace of 
(P), and the application 

h ^ (h), he 

defines a Hilhert space isomorphism between S)®'^ , endowed with the inner product ql(-, •)f,®9, 
and Cq{X). 

2. For every q,q' > such that q 7^ q' , the spaces Cq (X) and Cqi (X) are orthogonal in 
L2 (P) . 

3. Let F be a functional of the isonormal Gaussian process X satisfying K[F{X)'^] < 00: 
then, there exists a unique sequence {fq : q > 1} such that fq € ij®"^, and 

00 

F = E(F) + ^/f (/,), 

q=l 

where the series converges in (P) . 

4- Suppose that S) = {ZjZ^u), where v is a-finite and non-atomic. Then, for q > 2, the 
symmetric power ij®*^ can be identified with L'^ (Z'^ , Z'^ , v'^) and, for every f S Sj®'^, the 
random variable (/) coincides with the Wiener-Ito integral (see Definition\B^ of f with 
respect to the Gaussian measure given by A ^ X {\a), A e Zy. 

Remark. The combination of Point 1. anf Point 2. in the statement of Proposition 18.11 
implies that, for every q,q' > 1, 

E[/f (/)/,T (/')]= (/,/') 

(compare with (j5.42|) ). 
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8.3 Contractions, products and some explicit formulae 

We start by introducing the notion of contraction in the context of powers of Hilbert spaces. 

Definition 12 Consider a real separable Hilbert space Sj, and let {ci : i > 1} be an orthonormal 
basis of f). For every n,m > 1, every r = 0, ...,n A m and every f S ij®" and g S i^®™, we 
define the contraction of order r, of f and g, as the element oy^®"+"^-2r gj^y^^ 

oo 

f ®r g = ^ (/, (g) • • • (g) CjJ^^r (5,eii <8) • • • (g) ev)j^®r , (8.6) 

«l,...,ir = l 

and we denote by f (g),. g its symmetrization. 



Remark. One can prove (Exercise!) the following result: \i = {Z,Z,v), f G i^®" = 
Ll {Z'\ Z"-, I/") and g G ^®'" = (Z™, Z"^ , i^™), then the definition of the contraction / 0^ 5 
given in (18. 6p and the one given in (j6.16p coincide. 

The following result extends the product formula (j6.17p to the case of isonormal Gaussian 
processes. The proof (which is left to the reader) can be obtained from Proposition l6.lt by using 
the fact that every real separable Hilbert space is isomorphic to a space of the type L? (Z, Z, v), 
where v is (j-finite and non-atomic. An alternative proof (by induction) can be found in [75^ Ch. 
!]■ 

Proposition 8.2 Let X be an isonormal Gaussian process over some real separable Hilbert 
space Sj. Then, for every n,m > 1, / G ^O" and g £ ij®"*, 

mAn 

I m \ / Tj \ / ^ \ 

(8.7) 



•riL/xii / \ / \ 

if)!^ (9) = E 4 J ( {f 

r=0 V / V / 



where the symbol ( ) indicates a symmetrization, the contraction f ®r 9 is defined in i8. 6\) . and 
for m = n = r, we write 

lo (/ 5) = (/, 5)i5®n ■ 



We stress that one can obtain a generalization of the cumulant formulae (|7.29p in the frame- 
work of isonormal Gaussian processes. To do this, one should represent each integral of the 
type Jz„/2 fadv^f^, appearing in (j7.29p . as the inner product between two iterated contractions 
of the kernels {/n }; and then use the canonical isomorphism between and a space of the 
form {Z,Z,v). However, the formalism associated with this extension is rather heavy (and 
not really useful for the discussion to follow), and is left to the reader. Here, we will only state 
the following formula (proved in [79]) giving an explicit expression for the fourth cumulant of a 
random variable of the type if (/), / G ^®'^, d>2: 



X4 



If if)) 



d-i 

E 



X 



if) ^ 



HdifWfW 



4 



\f ®P /ll^®2{d- 



+ 



2d 
d 



2p 
P 



f^pf 



.(8.9) 
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As pointed out in \79\ Corollary 2], formula (j8.9p can be used in order to prove that, for 
every isonormal Gaussian process X, every d > 2 and every / G Sj®"^, the random variable 
(/) co.f^'noi Gaussian (see also [Ml Ch. 6]). 

Example. We focus once again on isonormal Gaussian processes of the type = {Xjj (ip) : 
£ ^E,i3}, where the Hilbert space SjE,i3 is given in ()8.2|) . In this case, for d > 2, the sym- 
metric power Sj'^'^f^ can be identified with the real Hilbert space of those functions V'd that 

are symmetric on {—it, tt]'^, square integrable with respect to /J*^, and such that ipd (xi, x^) = 
'4'd (—3^1) •••! —Xd) ■ For every ni, > 1, one can write explicitly a diagram formula as follows: 

creM2([n],n*) 

where {[n] ,tt*) is defined in (j7.2ip and tl^u is the function in (rii + • • • + n^) /2 variables 
obtained by setting Xi = —Xj in <^o ■ ■ ■ ®o V'rf if and only if i ~o- j- The field Xp is often 
defined in terms of a complex Gaussian measure (see [11^ [24l [49] ) . 



9 Simplified CLTs, contractions and circular diagrams 

In a recent series of papers (see [52l |65l |69l [TOl [Til [76l [79l [83l IMl E] for the Gaussian case, and 
|86l \87\ [88l [89 ] for the Poisson case) a set of new results has been established, allowing to obtain 
neat Central Limit Theorems (CLTs) for sequences of random variables belonging to a fixed 
Wiener chaos of some Gaussian or Poisson field. The techniques adopted in the above references 
are quite varied, as they involve stochastic calculus ([79, 831 [91]), Malliavin calculus ( [65 [ [76l [90] ) . 
Stein's method ( [Ml [TQl [Til [86] ) and decoupling ( pH [871 [89] ) . However, all these contributions 
may be described as "drastic simplifications" of the method of moments and cumulants (see e.g. 
[Ill [49] , as well as the discussion below) which is a common tool for proving weak convergence 
results for non linear functionals of random fields. 

The aim of this section is to draw the connection between the above quoted CLTs and the 
method of moments and cumulants into further light, by providing a detailed discussion of the 
combinatorial implications of the former. This discussion will involve the algebraic formalism 
introduced in Section [IHll as well as the diagram formulae proved in Section [7l 

9.1 A general problem 

In what follows, we will be interested in several variations of the following problem. 

Problem A . Let (p be a completely random Gaussian or Poisson measure over some space 
{Z,Z,v), where v is a-finite and non-atomic. For m > 1 and di,...,dm > 1, let {fj^^ : 
j = l,...,m, k > 1} be a collection of kernels such that fj''^ € (Z'^j , ^"^j , i/'^j) (the vector 
(di, ...,dm) does not depend on k), and 



hm E 

fc— >oo 



(/f ) II (/f )1 = ^ (^'^■) ' 1 < < (9-1) 



where the integrals yfi^'^j are defined via Ili5.41\ ) and C = {C {i,j)} is a m x m positive 
definite matrix. We denote by (0, C) a m-dimensional centered Gaussian vector with co- 
variance matrix C. Find conditions on the sequence (^f[''\ ...,fm^^, k >1, in order to have the 
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CLT 

We observe that, if di ^ dj in (j9.1|) . then necessarily C = by Point 2 in Proposition 
18.11 The relevance of Problem A comes from the chaotic representation (j5.45p . implying that a 
result such as (|9.2|) may be a key tool in order to establish CLTs for more general functionals of 
the random measure ^p. We recall (see e.g. [361 Ch. 6]) that, if (p is Gaussian and d >2, then a 
random variable of the type (/) cannot be Gaussian. 

Plainly, when ip is Gaussian, a solution of Problem A can be immediately deduced from the 
results discussed in Section [7.21 Indeed, if the normalization condition (j9.ip is satisfied, then the 
moments of the sequence {F^} are uniformly bounded (to see this, one can use (|5.46p ). and the 
CLT ()9.2p takes place if and only if every cumulant of order > 3 associated with F^, converges 
to zero when A; — > oo. Moreover, an explicit expression for the cumulants can be deduced from 
(j7.29p . This method of proving the CLT (|9.2p (which is known as the method of cumulants) 
has been used e.g. in the references [9l [TTl [231 ED IMl ES], where the authors proved CLTs for 
non-linear functionals of Gaussian fields with a non trivial covariance structure (for instance, 
sequences with long memory or isotropic spherical fields). However, such an approach (e.g. in 
the study of fractional Gaussian processes) may be technically quite demanding, since it involves 
an infinity of asymptotic relations (one for every cumulant of order > 3) . If one uses the diagram 
formulae ()7.29p , the method of cumulants requires that one explicitly computes and controls an 
infinity of expressions of the type fa^kdv^^"^ , where the partition a is associated with a 

non- flat, Gaussian and connected diagram (see Section [4T|) . 

Remarks, (i) We recall that (except for trivial cases), when (p is Gaussian the explicit 
expression of the characteristic function of a random variable of the type /^(/), d > 3, is 
unknown (for d = 2 see e.g. [79l p. 185]). 

(ii) Thanks to the results discussed in Section [7.31 (in particular, formula (j7.39p ). the method 
of cumulants and diagrams can be also used when 99 is a completely random Poisson measure. 
Clearly, since (I7.39P also involves non-Gaussian diagrams, the use of this approach in the Poisson 
case is even more technically demanding. 

In the forthcoming sections we will show how one can successfully bypass the method of 
moments and cumulants when dealing with CLTs on a fixed Wiener chaos. 

9.2 One-dimensional CLTs in the Gaussian case 

We now consider an isonormal Gaussian process X = {X {h) : /i G ij} over some real separa- 
ble Hilbert space i^. Recall (see Section [8|) that the notion of isonormal Gaussian process is 
more general than the one of Gaussian measure. The following result involves one-dimensional 
sequences of multiple stochastic integrals, and collects the main findings of [79] and [63|. We 
recall that the total variation distance, between the law of two general real-valued random 
variables Y and Z, is given by 

dTV {Y, Z) = sup \F{Y £ B) - F{Z £ B)\, 

where the supremum is taken over all Borel sets B £ B (M) . Observe that the topology induced 
by dTV, on the class of probability measures on M, is strictly stronger than the topology of 
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law 



weak convergence and thus lim^^oo drviBn, -B) = is a stronger result than Bn —>■ B (see e.g. 
Dudley [171 Ch. 11] for a discussion of other relevant properties of dTv)- 

Theorem 9.1 (See [79j and |69] ) Fix an integer d > 2, and define the operator I-^ according 
to i8. 5\) . Thenjor every sequence {^f^^^ : A; > l} such that f^^^ G ij®"^ for every k, and 



lim d\ 

k—*oo 



(k) 



= lim E 



I, 



(9.3) 



the following three conditions are equivalent 

1. limfc^ooX4(/f = ; 

2. for every r = 1, d — 1, 



lim 



32(d-r) 



(9.4) 



where the contraction f^^^ ®r f^^'^ is defined according to i8. 6\} : 



3. as k ^ oo, the sequence {/^ (/'•*'^) '■ k > 1^ converges towards a centered standard Gaus- 
sian random variable Z ^ N (0,1) . 



Moreover, the following bound holds for every fixed k: 

(//(/'"). ^)'<(i-<i!||/'ii;„) 

+d^^(2g-2r)!(r- 1)!^ 



(9.5) 



q-l 
r-1 



/^') f 



(k) 



i2(d-r) 



Observe that condition (1.) in the previous statement holds if and only if 

4" 



lim E 

fc^oo 



3. 



The equivalence of (1.), (2.) and (3.) has been first proved in [79] by means of stochastic 
calculus techniques. The paper [76j contains an alternate proof with additional necessary and 
sufficient conditions, as well as several crucial connections with Malliavin calculus operators (see 
e.g. [75j)- The upper bound (j9.5p is proved in [69j, by means of Malliavin calculus and the 
so-called Stein's method for normal approximation (see e.g. [119J). 



Remark. Theorem 19. H as well as its multidimensional generalizations (see Section [97 
below), has been applied to a variery of frameworks, such as: quadratic functionals of bivari- 
ate Gaussian processes (see jE]), quadratic functionals of fractional processes (see |79j), high- 
frequency limit theorems on homogeneous spaces (see \52\ [53] ) , self- intersection local times of 
fractional Brownian motion (see [291 [76] ) , Berry-Esseen bounds in CLTs for Gaussian subordi- 
nated sequences (see [69l [TQl [71]), needleets analysis on the sphere (see [5j), power variations 
of iterated processes (see [68] ) , weighted variations of fractional processes (see l66i l72j ) and of 
related random functions (see [5] [T5]). 
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9.3 Combinatorial implications of Theorem 19.1] 



The implication (1.) =^ (3.) in Theorem 19.11 provides the announced "drastic simphfication" 
of the methods of moments and cumulants. However, as demonstrated by the apphcations of 
Theorem 19.11 hsted above, condition (19. 4p is often much easier to verify. Indeed, it turns out 
that the imphcation (2.) =^ (3.) has an interesting combinatorial interpretation. 

To see this, we shall fix d > 2 and suppose that = {Z,Z,u), with u a c-finite and 
non-atomic measure. According to Proposition 18. H in this case the random variable (/), 
where f £ Li (^Z"^ , Z'^ , u'^^ = {i^'^), is the multiple Wiener-Ito integral of / with respect to 
the Gaussian measure A ^ X {1a_), as defined in Definition [5l We shall also use some notation 
from Sections [2H7l in particular: 

• For every n > 2, the symbol it* {[nd]) G V {[nd]) stands for the partition of [nd] = 
{1, 2, nd} obtained by taking n consecutive blocks of size d, that is: 

n* {[nd]) = {{l,...,d} ,{d+l,....,2d} ,...,{{n-l)d+l,...,nd}} . 

• The class of partitions Ai2 {[n'd] ,vr* ([nd])) is defined according to formula (I7.2ip . Recall 
that, according to (j7.27p . a partition a (z V {[nd]) is an element of A^2 {[nd] ,tt* {[nd])) if 
and only if the diagram F (vr* {[nd]) ,a) (see Section l4T]l is Gaussian, non-flat and con- 
nected, which is equivalent to saying that the graph F (tt* {[nd]) ,a) (see Section H?3]) is 
connected and has no loops. 

• As in formula (j7.29p . for every / € (^'^)) every n such that nd is even, and every 
a € M.2{[n.d] , vr* ([nd])), we denote by /o-,n the function in dn/2 variables, obtained by 
identifying two variables Xi and xj in the argument of 

/ (^o- ' -Oq / (9.6) 

n times 

if and only if i j- 
We will also denote by 

MU[nd],7T*{[nd])) 

the subset of A42 {[nd] ,7r* ([nd])) composed of those partitions a such that the diagram 

T{7T*{[nd]),a) 

is circular (see Section [4.ip . We also say that a partition a € ib^^] ([^'^])) ^^^.s ranic r 
{r = l,...,d — 1) if the diagram F (vr* ([nd]) ,a) has exactly r edges linking the first and the 
second row. 

Examples, (i) The partition whose diagram is given in Fig. 24 (Section 17. 2p is an element 

of 

MU[8],7r*{[9])) 

and has rank r = 1. 
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(ii) Consider the case d = 3 and n = 4, as well as the partition a £ M2 ([12] , vr* ([12])) given 
a = {{1, 4} , {2, 5} , {3, 12} , {6, 9} , {7, 10} , {8, 11}} . 



Then, the diagram T (vr* ([12]) , a) is the one in Fig. 28, and therefore a G A^^ ([12] , vr* ([12])) 
and a has rank r = 2. 




Figure 28: A circular diagram 



The following technical result links the notions of circular diagram, rank and contraction. 
For d > 2 and a G M2 ii^d] ,tt* {[4d])), let /o-,4 be the function in 2d variables obtained by 
identifying Xj and xj in the argument of the tensor product (j9.6p (with n = 4) if and only if 
i j. For instance, if c? = 3 and a G ([12] , vr* ([12])) is associated with the diagram in Fig. 
28, then 

faAixi,X2,X3,Xi, X5,Xq) = f {xi, X2, X3) f {xi, X2, Xi) f {x^, Xq, Xi) f {x^, Xq, X3) . 

Lemma 9.1 Fix f £ Li [v'^), d > 2, and, for r = 1, ...,d — 1, define the contraction f ®r f 
according to i6.16\} . Then, for every a G M2 ii^d] ,7r* ([4(i])) with rank r G {1, ...,d — 1}, 



Z2d 



fa,4d^ 



2d 



1/ ®r /|i^2^i,2(d-r)) - 11/ ^d-r /||i2(^2r) 



(9.7) 



Proof. It is sufficient to observe that / is symmetric by definition, and then to use the 
relation 

11/ ®r /||^2(-j,2{d-r-)-) 

= / / / / f iad-r,hr) f {hr,a'a_r) ^ 

J Z'i-^ JZ'i-^ J J Z'' 

X / (a'^_„ b;) / (b;, arf_,) z.'^-'- [d^d-r) v''-'' {da'd-r) {dhr) {dh',) . 



Remark. Formula ()9.7p implies that, for a fixed / and for every a G AI2 ([4(i] ,vr* ([4(i])), 
the value of the integral f^2d fadf'^'^ depends on a uniquely through r (or d — r), where r is the 
rank of a. 

By using Lemma l9.H one obtains immediately the following result, which provides a combi- 
natorial description of the implication (2.) =^ (3.) in Theorem 19. 1[ 

Proposition 9.1 For every d > 2 and every sequence {f^^^ ■ k > 1^ C (i^'*) such that 



d\\\f^'m 



1 (k ^ 00), the following relations are equivalent: 
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1. as k ^ oo 



(TeM2{lnd],TT*{[nd])) 

2. for every partition a £ M.\ ([4d] ,7r* ([4d])), as k ^ oo, 



y / ^ 0, Vn>3; (9.8) 



/^'=)dz.2d ^ 0. (9.9) 

Z2d 



Proof. Thanks to formula 17.291 one deduces that 

a&M2{[nd\,iT''{[nd\)) •' Z'"-"^'^ 

where {f^^^^ is the multiple Wiener-Ito integral of f^^^ with respect to the Gaussian measure 
induced by X, and Xn indicates the nth cumulant. It follows that, since f^! H/^'^^ ||^2^j,dj = 

E [If (/('=))] ^ 1, relation is equivalent to if (/('=)) Z ^ N (0, 1). On the other hand, 
one deduces from Lemma |9. II that (j9.9p takes place if and only if (j9.4p holds. Since, according 

to Theorem 19.11 condition ()9.4p is necessary and sufficient in order to have (Z*-^^) ^ Z, we 
immediately obtain the desired conclusion. ■ 

Corollary 9.1 Fix d > 2 and suppose that the sequence {/(^) : A: > 1} C L2 ( u'^) is such that 
dl 1 1 /^''^ 1 1 5,2 (^d) ^1 (k^oo). Then, (EJj takes places if and only if {f^^^) Z ~ iV(0, 1). 

Proof. As pointed out in the proof of Proposition 19.11 since the normalization condition 
d\ ||/'''^'*||L2(|,^d^ ^ 1 is in order, relation (j9.8p is equivalent to the fact that the sequence (/^'^^), 
A; > 1, converges in law to a standard Gaussian random variables. The implication (2.) =^ (1.) 
in the statement of Proposition 19.11 vields the desired result. ■ 

Remarks. (1) Corollary 19.11 implies that, in order to prove a CLT on a fixed Wiener chaos, 
it is sufficient to compute and control a finite number of expressions of the type f^2d f'^^dv'^'^, 
where a is associated with a connected Gaussian circular diagram with four rows. Moreover, 
these expressions determine the speed of convergence in total variation, via the upper bound 
given in (j9.5p . 

(2) Relation (19. 7p also implies that: (i) for d even, ()9.9I) takes place for every 

if and only if for every r = l,...,d/2, there exists a partition o" E ii'^d] ,7r2 ([4(i])) with rank 
r and such that (f9^ holds; (ii) for d odd, ([9^91) takes place for every a G M2 ([4d] ,tt2 ([4d])) if 
and only if for every r = 1, {d + l)/2, there exists a partition a E M2 ([4(i] , vr^ ([4(i])) with 
rank r and such that (j9.9p holds. 

(3) When d = 2, the implication (19. 9p =^ (19. 8p is a consequence of the fact that, for ev- 
ery n > 3 and up to a permutation of the rows, the diagram associated with any element of 
7W2 ([2?i,] ,TT2 ([2n])) is equivalent to a circular diagram (this fact has been already pointed out 
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at the end of Section [7.2p . For instance, it is always possible to permute the blocks of vTg ([10]) 
in such a way that the diagram r(7r2 ([10]) ,a), associated with some a G AI2 ([10] ,vr2 ([10])), 
has the form of the diagram in Fig. 29. By using this fact, one can prove that (j9.9p =^ (|9.8p 
by means of the Cauchy-Schwarz inequality and of a recurrence argument (for another proof of 
Theorem 19.11 in the case d = 2, by means of an explicit expression of the Fourier transform of 
/2^(/('=)),see[79lp. 185]). 




Figure 29: A circular diagram with Eve rows 



9.4 A multidimensional CLT 

The paper [9l] (but see also [TU \77\ [83]) contains a complete solution of Problem A in the 
Gaussian case, for every m > 2. For such an index m, we denote by Vm the set of all vectors 
(^1,^2,^3)^4) £ (1, ...,m)^ such that at least one of the following three properties is verified: (a) 
h ^2 = h = H, (b) ii 7^ ^2 = ^3 7^ ^4 and ^4 7^ ii, (c) the elements of (ii,...,Z4) are all 
different. In what follows, X = {X (h) : h G Sj} indicates an isonormal Gaussian process over a 
real separable Hilbert space ^. 

Theorem 9.2 Let m>2 and di, ■■.,dm > 1 be fixed and let 

{/f):j = l,...,m, A:>l} 



be a collection of kernels such that /j*^'' G i^®'*^ and the normalization condition 119. 1\) is verified. 
Then, the following conditions are equivalent: 

1. as k ^ 00, the vector Fk = (^/i'^'') '•■•'-^rfL (^/m^^^ converges in law towards a m- 
dimensionnel Gaussian vector (0, C) = {Ni, Nm) with covariance matrix C = 
{C{i,j)}; 



lim E 

fc— >oo 



. i=l,...,m 



l<i<j<r?i 



i=l 



\i=l 
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and 



y {ii,i2,i3,u) G Vm; 



lim E 

k~*oo 



.1=1 



E 



.1=1 



3. for every j = 1, ...,m, the sequence {jf^^^ k>l, converges in law towards Nj, that is, 
towards a centered Gaussian variable with variance C (j, j) ; 



4- Vj = l,...,m, limfc_^ooX4 [If^ (/j 



X ( Ak) 



5. Vj = 1, m 



lim 

fc— >oo 



0; 



(9.10) 



Vr = 1, dj — 1. 



The original proof of Theorem 19 . 2 1 uses arguments from stochastic calculus. See [71] and [77], 
respectively, for alternate proofs based on Malliavin calculus and Stein's method. In particular, 
in LZlJ can find bounds analogous to (|9.5|) . concerning the multidimensional Gaussian ap- 
proximation of Ffc in the Wasserstein distance. The crucial element in the statement of Theorem 
19.21 is the implication (3.) =^ (1.), which yields the following result. 

Corollary 9.2 Let the vectors F^, k > 1, be as in the statement of Theorem \9.S\ and suppose 
that (EJP is satisfied. Then, the convergence in law of each component of the vectors Fyt , towards 
a Gaussian random variable, always implies the joint convergence of F^ towards a Gaussian 
vector with covariance C. 

Thanks to Theorem 19.11 it follows that a CLT such as (j9.2p can be uniquely deduced from 
(j9.ip and from the relations (j9.10p . involving the contractions of the kernels /j'^''- 

When Sj = {Z, Z, v) (with v non atomic), the combinatorial implications of Theorem 19.21 
are similar to those of Theorem 19. 11 Indeed, thanks to the implication (5.) =^ (1.), one deduces 

that, for a sequence (^f^\ A; > 1, as in (j9.ip . if 

/ (/f) dv^'^^Q, VaGA^§([4d],7r*([4d])), 

then 

/ 7n/2 

(7eA42([n],7r*)-'^ 

for every integer n which is the sum of £ > 3 components {di^ , djj, di^) of the vector {di, ■■.,dm) 
(with possible repetitions of the indices zi, ...,i^), with 

vr* = {{I, ...,di,} , {di + ... + d,^_^ + I, ...,n}] eV{[n]), 

(k) 

and every function /^/, in n/2 variables, is obtained by identifying two variables Xk and Xj in 
the argument of /j^ <^o • • • fi^ if and only if k ~o- j. 
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As already pointed out, the chaotic representation property (|5.45p allows to use Theorem l9.2l 
in order to obtain CLTs for general functionals of an isonormal Gaussian process X. We now 
present a result in this direction, obtained in [29], whose proof can be deduced from Theorem 



Theorem 9.3 (See [29j) We consider a sequence {Fk : > 1} of centered and square-integrable 
functionals of an isonormal Gaussian process X, admitting the chaotic decomposition 



oo 

F. = E'^{f'f'), k>i. 



d=l 



Assume that 



limAT^oo limsupfc^^ 22d>N+i ^! fd 



for every d > 1, limfc^oo d\ 

d=l ^d = ^ < 



-I 



0, 



for every d>l, limfc^oo ff^ ff^ 



52(d-r) 



0, Vr = 1. 



Then, as k oo, N (0,(T^), where N (O, cj^) is a centered Gaussian random variable 

with variance a^. 



9.5 Simplified CLTs in the Poisson case: the case of double integrals 

We conclude this survey by discussing a simplified CLT for sequences of double integrals with 
respect to a Poisson random measure. Note that this result (originally obtained in [89]) has 
been generalized in [86], where one can find CLTs for sequences of multiple integrals of arbitrary 
orders - with explicit Berry-Esseen bounds in the Wasserstein distance obtained once again via 
Stein's method. 

In this section, (Z, Z, v) is a measure space, with v u-finite and non-atomic. Also, N = 
{N (B) : B G Zjj} is a compensated Poisson measure with control measure given by v. In [89], 
we have used some decoupling techniques developed in [87] in order to prove CLTs for sequences 
of random variables of the type: 

Fk = li (^f^^^), k>l, (9.11) 

where /^^^^ G (^^)- particular, we focus on sequences {F^} satisfying the following assump- 
tion 

Assumption N. The sequence f^^\ /c > 1, in (IgrTT) verifies : 
N.i (integrability) V/c > 1, 

1 

j^f^^\z,.fu{dz)eL\v) and i^j ^f<^^ {z,.f u {dz)Y ^ L\u) ■ (9.12) 
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N.ii (normalization) As k ^ oo, 

2 [ [ f('^z,zfu{dz)u{dz')^l; 



(9.13) 



Z JZ 



N.iii (fourth power) As — > oo, 




Z JZ 



/(^•) [z,z')'^v{dz)v[dz') ^ 



(9.14) 



(in particular, this implies that f^^'^ £ (^^))- 



Remarks. (1) The conditions in (j9.12p are technical : the first ensures the existence of the 
stochastic integral of J"^ f^^^ (z, •)^ u (dz) with respect to N; the second allows to use some Fubini 
arguments in the proof of the results to follow. 

(2) Suppose that there exists a set B, independent of n, such that u (B) < oo and Z^^-* = 
1b, a.e.-du'^, \/k > 1 (this holds, in particular, when u is finite). Then, by the Cauchy- 
Schwarz inequality, if ()9.14p is true, then [f^'^^) converges necessarily to zero. Therefore, in 
order to study more general sequences (Z^'^-'), we must assume that (Z) = +oo. 

The next theorem is the main result of 1891. 



Theorem 9.4 Let = I2 U^^^) with G Ll{v'^), k>l, and suppose that Assumption N is 
verified. Then, J^^') f^^^ G L'^{u^) and /(^'^ G L1{u^), Mk > 1, and also : 



1. tf 



and 



, 



then 



(9.15) 
(9.16) 



where N (0, 1) is a centered Gaussian random variable with unitary variance. 
2. if F). G (P), V/c, a sufficient condition in order to have i9.15]) is 

X4 (Fn) ^ 0; 



(9.17) 



3. if the sequence {F^ : k > 1^ is uniformly integrable, then the three conditions ^9.15\) . 119. 16\) 



and (9.11) are equivalent. 



Remark. See |14] and [S^ for several applications of Theorem 19.41 to Bayesian non- 
parametric survival analysis. 

We now give a combinatorial interpretation (in terms of diagrams) of the three asymptotic 
conditions appearing in formulae (j9.14p and (j9.15p . To do this, consider the set [8] = {1, ...,8}, 
as well as the partition vr* = {{1, 2} , {3, 4} , {5, 6} , {7, 8}} G V{[S]). We define the set of 
partitions M>2 ([8] ,7r*) CV ([8]) according to ()7.23p . Given an element a G M>2 ([8] ,7r*) and 
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given f £ (z^'^), the function /o-,4, in \a\ variables, is obtained by identifying the variables Xi 
and Xj in the argument of f ®o f (giQ f ®o f (as defined in (j6.3p ) if and only if i ~o- j- We define 
three partitions cri,a2,cr3 € M.>2 ([8] ,7r*) as follows: 

fji = {{1,3, 5, 7}, {2, 4, 6, 8}} 
C72 = {{1,3, 5, 7}, {2, 4}, {6, 8}} 
= {{1,3}, {4, 6}, {5, 7}, {2, 8}}. 

The diagrams r(7r*,cri), r(7r*,(j2) and r(7r*,cr3) are represented (in order) in Fig. 30. 



Figure 30: Three diagrams associated with contractions 



One has therefore the following combinatorial representation of the three norms appearing 
in formulae (j9.14p and ()9.15p (the proof is elementary, and left to the reader) . 

Proposition 9.2 For every f ^ (i^^), one has that 



z JZ 



f (z, z')^ u (dz) u {dz^ 



f {z,zY u{dz) 



[dz') 



Z2 



/ {z, z) f [z, z") V {dz) 



V {dz) V {dz") 



i4(j,2) = y^_^ /<xi,4 [z, z) V {dz) V {dz') 



/||l2(v) 



1 ^l|2 



f<T2A {z)v{dz) 



f<T3A {z)v{dz) . 



In particular. Proposition 19.21 implies that, on the second Wiener chaos of a Poisson measure, 
one can establish CLTs by focusing uniquely on expressions related to three connected diagrams 
with four rows. Similar characterizations for sequences belonging to chaoses of higher orders 
can be deduced from the main findings of [85]. 
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